Class cascading.SortedValuesPlatformTest

4

tests

0

failures

1m31.14s

duration

100%

successful

Tests

Test Duration Result
testCoGroupComparatorValues 25.721s passed
testCoGroupComparatorValuesReversed 32.308s passed
testComprehensiveGroupBy 33.072s passed
testSortFails 0.035s passed

Standard output

2014-08-22 22:43:46,062 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(187)) - found 1 test platforms from classpath
2014-08-22 22:43:46,127 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(237)) - installing platform: hadoop2-mr1
2014-08-22 22:43:46,127 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(238)) - running test: cascading.SortedValuesPlatformTest
2014-08-22 22:43:46,177 INFO  hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(106)) - not using cluster
2014-08-22 22:43:46,820 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2014-08-22 22:43:47,115 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2014-08-22 22:43:47,117 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.6/31997f144a2e73eebf04d45ed31402ee30118b2/cascading-hadoop2-mr1-2.5.6.jar
2014-08-22 22:43:47,129 INFO  property.AppProps (AppProps.java:getAppID(162)) - using app.id: 1B24E3AD50B84D97906DAE4FC3EC4AB5
2014-08-22 22:43:47,222 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-08-22 22:43:47,270 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-22 22:43:47,273 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-08-22 22:43:47,414 INFO  util.Version (Version.java:printBanner(78)) - Concurrent, Inc - Cascading 2.5.6
2014-08-22 22:43:47,418 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [apache*ip] starting
2014-08-22 22:43:47,419 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [apache*ip]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/apache.200.txt"]
2014-08-22 22:43:47,419 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [apache*ip]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/ips.20.txt"]
2014-08-22 22:43:47,420 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [apache*ip]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/cogroupcomparereversed"]
2014-08-22 22:43:47,422 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [apache*ip]  parallel execution is enabled: false
2014-08-22 22:43:47,423 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [apache*ip]  starting jobs: 1
2014-08-22 22:43:47,423 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [apache*ip]  allocating threads: 1
2014-08-22 22:43:47,424 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [apache*ip] starting step: (1/1) ...rm/cogroupcomparereversed
2014-08-22 22:43:47,449 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - session.id is deprecated. Instead, use dfs.metrics.session-id
2014-08-22 22:43:47,450 INFO  jvm.JvmMetrics (JvmMetrics.java:init(76)) - Initializing JVM Metrics with processName=JobTracker, sessionId=
2014-08-22 22:43:47,477 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:43:47,869 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:43:47,880 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:43:47,913 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:2
2014-08-22 22:43:48,074 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local150453582_0001
2014-08-22 22:43:48,123 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity150453582/.staging/job_local150453582_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:43:48,134 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity150453582/.staging/job_local150453582_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:43:48,322 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local150453582_0001/job_local150453582_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:43:48,329 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local150453582_0001/job_local150453582_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:43:48,336 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-08-22 22:43:48,337 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-08-22 22:43:48,340 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [apache*ip] submitted hadoop job: job_local150453582_0001
2014-08-22 22:43:48,340 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [apache*ip] tracking url: http://localhost:8080/
2014-08-22 22:43:48,340 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-08-22 22:43:48,401 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-08-22 22:43:48,406 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local150453582_0001_m_000000_0
2014-08-22 22:43:48,450 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:43:48,460 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/apache.200.txt
2014-08-22 22:43:48,460 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@2a24bfaa
2014-08-22 22:43:48,470 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2014-08-22 22:43:48,477 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2014-08-22 22:43:48,623 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2014-08-22 22:43:48,623 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2014-08-22 22:43:48,623 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2014-08-22 22:43:48,624 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2014-08-22 22:43:48,624 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2014-08-22 22:43:48,649 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.5.6
2014-08-22 22:43:48,649 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2014-08-22 22:43:48,710 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.task.partition is deprecated. Instead, use mapreduce.task.partition
2014-08-22 22:43:48,730 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/apache.200.txt"]
2014-08-22 22:43:48,730 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: CoGroup(apache*ip)[by: apache:[{1}:'octet'] ip:[{1}:'rawoctet']]
2014-08-22 22:43:48,814 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2014-08-22 22:43:48,814 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2014-08-22 22:43:48,814 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2014-08-22 22:43:48,815 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 9461; bufvoid = 104857600
2014-08-22 22:43:48,815 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26213600(104854400); length = 797/6553600
2014-08-22 22:43:54,444 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/apache.200.txt:0+32599 > sort
2014-08-22 22:44:00,445 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/apache.200.txt:0+32599 > sort
2014-08-22 22:44:03,447 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/apache.200.txt:0+32599 > sort
2014-08-22 22:44:06,449 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/apache.200.txt:0+32599 > sort
2014-08-22 22:44:09,451 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/apache.200.txt:0+32599 > sort
2014-08-22 22:44:11,110 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2014-08-22 22:44:11,114 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local150453582_0001_m_000000_0 is done. And is in the process of committing
2014-08-22 22:44:11,116 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/apache.200.txt:0+32599
2014-08-22 22:44:11,117 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local150453582_0001_m_000000_0' done.
2014-08-22 22:44:11,117 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local150453582_0001_m_000000_0
2014-08-22 22:44:11,117 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local150453582_0001_m_000001_0
2014-08-22 22:44:11,119 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:44:11,121 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/ips.20.txt
2014-08-22 22:44:11,121 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@1646fef3
2014-08-22 22:44:11,123 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2014-08-22 22:44:11,123 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2014-08-22 22:44:11,151 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2014-08-22 22:44:11,152 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2014-08-22 22:44:11,152 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2014-08-22 22:44:11,152 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2014-08-22 22:44:11,152 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2014-08-22 22:44:11,155 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.5.6
2014-08-22 22:44:11,155 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2014-08-22 22:44:11,175 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/ips.20.txt"]
2014-08-22 22:44:11,175 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: CoGroup(apache*ip)[by: apache:[{1}:'octet'] ip:[{1}:'rawoctet']]
2014-08-22 22:44:11,181 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2014-08-22 22:44:11,181 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2014-08-22 22:44:11,181 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2014-08-22 22:44:11,181 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 142; bufvoid = 104857600
2014-08-22 22:44:11,182 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2014-08-22 22:44:13,338 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2014-08-22 22:44:13,341 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local150453582_0001_m_000001_0 is done. And is in the process of committing
2014-08-22 22:44:13,343 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/ips.20.txt:0+275
2014-08-22 22:44:13,343 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local150453582_0001_m_000001_0' done.
2014-08-22 22:44:13,344 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local150453582_0001_m_000001_0
2014-08-22 22:44:13,344 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-08-22 22:44:13,346 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2014-08-22 22:44:13,347 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local150453582_0001_r_000000_0
2014-08-22 22:44:13,355 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:44:13,358 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@4b0a4d7c
2014-08-22 22:44:13,372 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2014-08-22 22:44:13,376 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local150453582_0001_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2014-08-22 22:44:13,399 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#1 about to shuffle output of map attempt_local150453582_0001_m_000001_0 decomp: 184 len: 188 to MEMORY
2014-08-22 22:44:13,404 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 184 bytes from map-output for attempt_local150453582_0001_m_000001_0
2014-08-22 22:44:13,441 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 184, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->184
2014-08-22 22:44:13,445 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#1 about to shuffle output of map attempt_local150453582_0001_m_000000_0 decomp: 9863 len: 9867 to MEMORY
2014-08-22 22:44:13,446 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 9863 bytes from map-output for attempt_local150453582_0001_m_000000_0
2014-08-22 22:44:13,446 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 9863, inMemoryMapOutputs.size() -> 2, commitMemory -> 184, usedMemory ->10047
2014-08-22 22:44:13,447 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2014-08-22 22:44:13,449 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 2 / 2 copied.
2014-08-22 22:44:13,449 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 2 in-memory map-outputs and 0 on-disk map-outputs
2014-08-22 22:44:13,459 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 2 sorted segments
2014-08-22 22:44:13,482 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 2 segments left of total size: 10033 bytes
2014-08-22 22:44:18,253 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 2 segments, 10047 bytes to disk to satisfy reduce memory limit
2014-08-22 22:44:18,254 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 10049 bytes from disk
2014-08-22 22:44:18,256 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2014-08-22 22:44:18,256 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:44:18,257 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 10038 bytes
2014-08-22 22:44:18,258 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 2 / 2 copied.
2014-08-22 22:44:18,261 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.5.6
2014-08-22 22:44:18,261 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2014-08-22 22:44:18,281 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: CoGroup(apache*ip)[by: apache:[{1}:'octet'] ip:[{1}:'rawoctet']]
2014-08-22 22:44:18,282 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/cogroupcomparereversed"]
2014-08-22 22:44:18,304 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2014-08-22 22:44:18,304 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2014-08-22 22:44:18,356 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local150453582_0001_r_000000_0 is done. And is in the process of committing
2014-08-22 22:44:18,358 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 2 / 2 copied.
2014-08-22 22:44:18,358 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local150453582_0001_r_000000_0 is allowed to commit now
2014-08-22 22:44:18,359 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local150453582_0001_r_000000_0' to file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/cogroupcomparereversed/_temporary/0/task_local150453582_0001_r_000000
2014-08-22 22:44:18,361 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2014-08-22 22:44:18,362 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local150453582_0001_r_000000_0' done.
2014-08-22 22:44:18,362 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local150453582_0001_r_000000_0
2014-08-22 22:44:18,362 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2014-08-22 22:44:18,410 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/cogroupcomparereversed/_temporary
2014-08-22 22:44:18,444 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:44:18,482 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/cogroupcomparereversed
2014-08-22 22:44:18,509 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2014-08-22 22:44:18,509 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.6/31997f144a2e73eebf04d45ed31402ee30118b2/cascading-hadoop2-mr1-2.5.6.jar
2014-08-22 22:44:18,535 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-08-22 22:44:18,545 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-22 22:44:18,546 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-08-22 22:44:18,563 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [apache*ip] starting
2014-08-22 22:44:18,564 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [apache*ip]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/apache.200.txt"]
2014-08-22 22:44:18,564 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [apache*ip]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/ips.20.txt"]
2014-08-22 22:44:18,564 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [apache*ip]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/cogroupcompareforward"]
2014-08-22 22:44:18,564 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [apache*ip]  parallel execution is enabled: false
2014-08-22 22:44:18,565 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [apache*ip]  starting jobs: 1
2014-08-22 22:44:18,565 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [apache*ip]  allocating threads: 1
2014-08-22 22:44:18,565 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [apache*ip] starting step: (1/1) ...orm/cogroupcompareforward
2014-08-22 22:44:18,566 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:44:18,569 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:44:18,601 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:44:18,604 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:44:18,627 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:2
2014-08-22 22:44:18,681 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local973571689_0002
2014-08-22 22:44:18,698 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity973571689/.staging/job_local973571689_0002/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:44:18,699 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity973571689/.staging/job_local973571689_0002/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:44:18,775 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local973571689_0002/job_local973571689_0002.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:44:18,777 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local973571689_0002/job_local973571689_0002.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:44:18,778 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-08-22 22:44:18,778 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [apache*ip] submitted hadoop job: job_local973571689_0002
2014-08-22 22:44:18,779 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [apache*ip] tracking url: http://localhost:8080/
2014-08-22 22:44:18,779 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-08-22 22:44:18,779 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-08-22 22:44:18,784 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-08-22 22:44:18,785 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local973571689_0002_m_000000_0
2014-08-22 22:44:18,788 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:44:18,790 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/apache.200.txt
2014-08-22 22:44:18,790 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@41556f4c
2014-08-22 22:44:18,792 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2014-08-22 22:44:18,792 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2014-08-22 22:44:18,816 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2014-08-22 22:44:18,820 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2014-08-22 22:44:18,820 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2014-08-22 22:44:18,821 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2014-08-22 22:44:18,821 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2014-08-22 22:44:18,824 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.5.6
2014-08-22 22:44:18,824 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2014-08-22 22:44:18,844 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/apache.200.txt"]
2014-08-22 22:44:18,844 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: CoGroup(apache*ip)[by: apache:[{1}:'octet'] ip:[{1}:'rawoctet']]
2014-08-22 22:44:18,895 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2014-08-22 22:44:18,895 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2014-08-22 22:44:18,895 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2014-08-22 22:44:18,895 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 9461; bufvoid = 104857600
2014-08-22 22:44:18,895 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26213600(104854400); length = 797/6553600
2014-08-22 22:44:24,788 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/apache.200.txt:0+32599 > sort
2014-08-22 22:44:27,790 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/apache.200.txt:0+32599 > sort
2014-08-22 22:44:30,791 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/apache.200.txt:0+32599 > sort
2014-08-22 22:44:33,793 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/apache.200.txt:0+32599 > sort
2014-08-22 22:44:36,794 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/apache.200.txt:0+32599 > sort
2014-08-22 22:44:37,648 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2014-08-22 22:44:37,651 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local973571689_0002_m_000000_0 is done. And is in the process of committing
2014-08-22 22:44:37,655 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/apache.200.txt:0+32599
2014-08-22 22:44:37,656 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local973571689_0002_m_000000_0' done.
2014-08-22 22:44:37,656 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local973571689_0002_m_000000_0
2014-08-22 22:44:37,656 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local973571689_0002_m_000001_0
2014-08-22 22:44:37,658 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:44:37,660 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/ips.20.txt
2014-08-22 22:44:37,661 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@12bc8f01
2014-08-22 22:44:37,664 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2014-08-22 22:44:37,664 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2014-08-22 22:44:37,682 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2014-08-22 22:44:37,682 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2014-08-22 22:44:37,682 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2014-08-22 22:44:37,682 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2014-08-22 22:44:37,682 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2014-08-22 22:44:37,684 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.5.6
2014-08-22 22:44:37,685 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2014-08-22 22:44:37,701 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/ips.20.txt"]
2014-08-22 22:44:37,701 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: CoGroup(apache*ip)[by: apache:[{1}:'octet'] ip:[{1}:'rawoctet']]
2014-08-22 22:44:37,706 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2014-08-22 22:44:37,706 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2014-08-22 22:44:37,707 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2014-08-22 22:44:37,707 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 142; bufvoid = 104857600
2014-08-22 22:44:37,707 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2014-08-22 22:44:39,699 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2014-08-22 22:44:39,702 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local973571689_0002_m_000001_0 is done. And is in the process of committing
2014-08-22 22:44:39,704 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/ips.20.txt:0+275
2014-08-22 22:44:39,704 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local973571689_0002_m_000001_0' done.
2014-08-22 22:44:39,704 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local973571689_0002_m_000001_0
2014-08-22 22:44:39,705 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-08-22 22:44:39,705 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2014-08-22 22:44:39,705 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local973571689_0002_r_000000_0
2014-08-22 22:44:39,708 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:44:39,708 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@784d2125
2014-08-22 22:44:39,710 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2014-08-22 22:44:39,711 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local973571689_0002_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2014-08-22 22:44:39,714 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#2 about to shuffle output of map attempt_local973571689_0002_m_000000_0 decomp: 9863 len: 9867 to MEMORY
2014-08-22 22:44:39,715 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 9863 bytes from map-output for attempt_local973571689_0002_m_000000_0
2014-08-22 22:44:39,715 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 9863, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->9863
2014-08-22 22:44:39,718 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#2 about to shuffle output of map attempt_local973571689_0002_m_000001_0 decomp: 184 len: 188 to MEMORY
2014-08-22 22:44:39,718 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 184 bytes from map-output for attempt_local973571689_0002_m_000001_0
2014-08-22 22:44:39,718 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 184, inMemoryMapOutputs.size() -> 2, commitMemory -> 9863, usedMemory ->10047
2014-08-22 22:44:39,719 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2014-08-22 22:44:39,720 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 2 / 2 copied.
2014-08-22 22:44:39,720 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 2 in-memory map-outputs and 0 on-disk map-outputs
2014-08-22 22:44:39,723 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 2 sorted segments
2014-08-22 22:44:39,745 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 2 segments left of total size: 10035 bytes
2014-08-22 22:44:44,044 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 2 segments, 10047 bytes to disk to satisfy reduce memory limit
2014-08-22 22:44:44,045 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 10049 bytes from disk
2014-08-22 22:44:44,045 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2014-08-22 22:44:44,045 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:44:44,046 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 10039 bytes
2014-08-22 22:44:44,046 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 2 / 2 copied.
2014-08-22 22:44:44,048 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.5.6
2014-08-22 22:44:44,048 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2014-08-22 22:44:44,062 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: CoGroup(apache*ip)[by: apache:[{1}:'octet'] ip:[{1}:'rawoctet']]
2014-08-22 22:44:44,062 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/cogroupcompareforward"]
2014-08-22 22:44:44,074 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2014-08-22 22:44:44,075 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2014-08-22 22:44:44,114 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local973571689_0002_r_000000_0 is done. And is in the process of committing
2014-08-22 22:44:44,115 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 2 / 2 copied.
2014-08-22 22:44:44,116 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local973571689_0002_r_000000_0 is allowed to commit now
2014-08-22 22:44:44,116 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local973571689_0002_r_000000_0' to file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/cogroupcompareforward/_temporary/0/task_local973571689_0002_r_000000
2014-08-22 22:44:44,118 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2014-08-22 22:44:44,118 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local973571689_0002_r_000000_0' done.
2014-08-22 22:44:44,118 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local973571689_0002_r_000000_0
2014-08-22 22:44:44,119 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2014-08-22 22:44:44,149 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/cogroupcompareforward/_temporary
2014-08-22 22:44:44,181 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:44:44,206 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/cogroupcompareforward
2014-08-22 22:44:44,228 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2014-08-22 22:44:44,228 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.6/31997f144a2e73eebf04d45ed31402ee30118b2/cascading-hadoop2-mr1-2.5.6.jar
2014-08-22 22:44:44,261 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2014-08-22 22:44:44,262 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.6/31997f144a2e73eebf04d45ed31402ee30118b2/cascading-hadoop2-mr1-2.5.6.jar
2014-08-22 22:44:44,275 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-08-22 22:44:44,280 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-22 22:44:44,281 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-08-22 22:44:44,293 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort] starting
2014-08-22 22:44:44,293 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:44:44,294 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_null_false_false"]
2014-08-22 22:44:44,294 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  parallel execution is enabled: false
2014-08-22 22:44:44,294 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  starting jobs: 1
2014-08-22 22:44:44,294 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  allocating threads: 1
2014-08-22 22:44:44,295 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...ve/false_null_false_false
2014-08-22 22:44:44,297 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:44:44,299 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:44:44,330 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:44:44,352 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-08-22 22:44:44,390 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1619305519_0003
2014-08-22 22:44:44,404 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity1619305519/.staging/job_local1619305519_0003/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:44:44,406 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity1619305519/.staging/job_local1619305519_0003/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:44:44,451 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1619305519_0003/job_local1619305519_0003.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:44:44,452 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1619305519_0003/job_local1619305519_0003.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:44:44,453 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-08-22 22:44:44,454 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-08-22 22:44:44,454 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-08-22 22:44:44,454 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local1619305519_0003
2014-08-22 22:44:44,456 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2014-08-22 22:44:44,458 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-08-22 22:44:44,458 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1619305519_0003_m_000000_0
2014-08-22 22:44:44,461 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:44:44,462 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt
2014-08-22 22:44:44,463 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@7f7ef0a7
2014-08-22 22:44:44,464 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2014-08-22 22:44:44,464 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2014-08-22 22:44:44,490 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2014-08-22 22:44:44,494 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2014-08-22 22:44:44,497 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2014-08-22 22:44:44,497 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2014-08-22 22:44:44,498 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2014-08-22 22:44:44,501 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.5.6
2014-08-22 22:44:44,501 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2014-08-22 22:44:44,512 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:44:44,513 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:44:44,520 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2014-08-22 22:44:44,521 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2014-08-22 22:44:44,521 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2014-08-22 22:44:44,522 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 629; bufvoid = 104857600
2014-08-22 22:44:44,522 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2014-08-22 22:44:44,528 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2014-08-22 22:44:44,530 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1619305519_0003_m_000000_0 is done. And is in the process of committing
2014-08-22 22:44:44,535 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2014-08-22 22:44:44,535 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1619305519_0003_m_000000_0' done.
2014-08-22 22:44:44,536 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1619305519_0003_m_000000_0
2014-08-22 22:44:44,536 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-08-22 22:44:44,537 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2014-08-22 22:44:44,538 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1619305519_0003_r_000000_0
2014-08-22 22:44:44,540 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:44:44,541 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@6bb9808e
2014-08-22 22:44:44,542 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2014-08-22 22:44:44,543 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1619305519_0003_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2014-08-22 22:44:44,546 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#3 about to shuffle output of map attempt_local1619305519_0003_m_000000_0 decomp: 705 len: 709 to MEMORY
2014-08-22 22:44:44,547 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 705 bytes from map-output for attempt_local1619305519_0003_m_000000_0
2014-08-22 22:44:44,547 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 705, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->705
2014-08-22 22:44:44,548 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2014-08-22 22:44:44,549 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:44:44,550 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2014-08-22 22:44:44,553 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:44:44,553 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 700 bytes
2014-08-22 22:44:44,556 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 705 bytes to disk to satisfy reduce memory limit
2014-08-22 22:44:44,556 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 709 bytes from disk
2014-08-22 22:44:44,557 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2014-08-22 22:44:44,558 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:44:44,558 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 700 bytes
2014-08-22 22:44:44,559 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:44:44,560 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.5.6
2014-08-22 22:44:44,561 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2014-08-22 22:44:44,570 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:44:44,571 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_null_false_false"]
2014-08-22 22:44:44,590 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1619305519_0003_r_000000_0 is done. And is in the process of committing
2014-08-22 22:44:44,592 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:44:44,593 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local1619305519_0003_r_000000_0 is allowed to commit now
2014-08-22 22:44:44,594 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1619305519_0003_r_000000_0' to file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_null_false_false/_temporary/0/task_local1619305519_0003_r_000000
2014-08-22 22:44:44,596 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2014-08-22 22:44:44,597 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1619305519_0003_r_000000_0' done.
2014-08-22 22:44:44,597 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1619305519_0003_r_000000_0
2014-08-22 22:44:44,598 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2014-08-22 22:44:44,623 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_null_false_false/_temporary
2014-08-22 22:44:44,656 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:44:44,678 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2014-08-22 22:44:44,679 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.6/31997f144a2e73eebf04d45ed31402ee30118b2/cascading-hadoop2-mr1-2.5.6.jar
2014-08-22 22:44:44,694 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-08-22 22:44:44,699 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-22 22:44:44,700 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-08-22 22:44:44,709 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort] starting
2014-08-22 22:44:44,709 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:44:44,709 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_null_false_false"]
2014-08-22 22:44:44,710 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  parallel execution is enabled: false
2014-08-22 22:44:44,710 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  starting jobs: 1
2014-08-22 22:44:44,710 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  allocating threads: 1
2014-08-22 22:44:44,711 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...ive/true_null_false_false
2014-08-22 22:44:44,712 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:44:44,715 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:44:44,745 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:44:44,768 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-08-22 22:44:44,787 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1846430028_0004
2014-08-22 22:44:44,801 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity1846430028/.staging/job_local1846430028_0004/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:44:44,802 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity1846430028/.staging/job_local1846430028_0004/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:44:44,846 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1846430028_0004/job_local1846430028_0004.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:44:44,848 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1846430028_0004/job_local1846430028_0004.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:44:44,848 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-08-22 22:44:44,849 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local1846430028_0004
2014-08-22 22:44:44,849 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-08-22 22:44:44,849 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2014-08-22 22:44:44,849 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-08-22 22:44:44,853 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-08-22 22:44:44,853 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1846430028_0004_m_000000_0
2014-08-22 22:44:44,856 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:44:44,858 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt
2014-08-22 22:44:44,858 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@314d0183
2014-08-22 22:44:44,859 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2014-08-22 22:44:44,860 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2014-08-22 22:44:44,882 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2014-08-22 22:44:44,885 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2014-08-22 22:44:44,885 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2014-08-22 22:44:44,885 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2014-08-22 22:44:44,885 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2014-08-22 22:44:44,889 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.5.6
2014-08-22 22:44:44,889 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2014-08-22 22:44:44,902 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:44:44,902 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:44:44,909 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2014-08-22 22:44:44,910 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2014-08-22 22:44:44,910 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2014-08-22 22:44:44,910 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 629; bufvoid = 104857600
2014-08-22 22:44:44,910 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2014-08-22 22:44:47,354 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2014-08-22 22:44:47,357 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1846430028_0004_m_000000_0 is done. And is in the process of committing
2014-08-22 22:44:47,359 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2014-08-22 22:44:47,359 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1846430028_0004_m_000000_0' done.
2014-08-22 22:44:47,359 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1846430028_0004_m_000000_0
2014-08-22 22:44:47,360 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-08-22 22:44:47,360 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2014-08-22 22:44:47,360 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1846430028_0004_r_000000_0
2014-08-22 22:44:47,364 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:44:47,364 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@5b3409f
2014-08-22 22:44:47,364 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2014-08-22 22:44:47,365 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1846430028_0004_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2014-08-22 22:44:47,367 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#4 about to shuffle output of map attempt_local1846430028_0004_m_000000_0 decomp: 705 len: 709 to MEMORY
2014-08-22 22:44:47,368 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 705 bytes from map-output for attempt_local1846430028_0004_m_000000_0
2014-08-22 22:44:47,368 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 705, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->705
2014-08-22 22:44:47,369 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2014-08-22 22:44:47,370 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:44:47,370 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2014-08-22 22:44:47,373 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:44:47,373 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 700 bytes
2014-08-22 22:44:47,375 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 705 bytes to disk to satisfy reduce memory limit
2014-08-22 22:44:47,376 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 709 bytes from disk
2014-08-22 22:44:47,376 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2014-08-22 22:44:47,376 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:44:47,377 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 700 bytes
2014-08-22 22:44:47,377 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:44:47,378 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.5.6
2014-08-22 22:44:47,378 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2014-08-22 22:44:47,387 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:44:47,387 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_null_false_false"]
2014-08-22 22:44:47,403 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1846430028_0004_r_000000_0 is done. And is in the process of committing
2014-08-22 22:44:47,405 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:44:47,405 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local1846430028_0004_r_000000_0 is allowed to commit now
2014-08-22 22:44:47,406 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1846430028_0004_r_000000_0' to file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_null_false_false/_temporary/0/task_local1846430028_0004_r_000000
2014-08-22 22:44:47,408 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2014-08-22 22:44:47,408 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1846430028_0004_r_000000_0' done.
2014-08-22 22:44:47,408 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1846430028_0004_r_000000_0
2014-08-22 22:44:47,408 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2014-08-22 22:44:47,431 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_null_false_false/_temporary
2014-08-22 22:44:47,460 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:44:47,485 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2014-08-22 22:44:47,485 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.6/31997f144a2e73eebf04d45ed31402ee30118b2/cascading-hadoop2-mr1-2.5.6.jar
2014-08-22 22:44:47,496 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-08-22 22:44:47,500 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-22 22:44:47,501 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-08-22 22:44:47,509 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort] starting
2014-08-22 22:44:47,510 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:44:47,511 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_null_true_false"]
2014-08-22 22:44:47,511 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  parallel execution is enabled: false
2014-08-22 22:44:47,512 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  starting jobs: 1
2014-08-22 22:44:47,512 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  allocating threads: 1
2014-08-22 22:44:47,513 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...ive/false_null_true_false
2014-08-22 22:44:47,514 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:44:47,516 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:44:47,543 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:44:47,563 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-08-22 22:44:47,597 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local494440237_0005
2014-08-22 22:44:47,611 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity494440237/.staging/job_local494440237_0005/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:44:47,612 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity494440237/.staging/job_local494440237_0005/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:44:47,655 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local494440237_0005/job_local494440237_0005.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:44:47,656 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local494440237_0005/job_local494440237_0005.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:44:47,656 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-08-22 22:44:47,657 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local494440237_0005
2014-08-22 22:44:47,657 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2014-08-22 22:44:47,658 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-08-22 22:44:47,658 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-08-22 22:44:47,661 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-08-22 22:44:47,662 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local494440237_0005_m_000000_0
2014-08-22 22:44:47,664 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:44:47,665 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt
2014-08-22 22:44:47,666 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@2aa89e44
2014-08-22 22:44:47,667 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2014-08-22 22:44:47,667 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2014-08-22 22:44:47,685 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2014-08-22 22:44:47,685 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2014-08-22 22:44:47,685 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2014-08-22 22:44:47,685 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2014-08-22 22:44:47,685 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2014-08-22 22:44:47,688 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.5.6
2014-08-22 22:44:47,688 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2014-08-22 22:44:47,702 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:44:47,702 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:44:47,710 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2014-08-22 22:44:47,710 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2014-08-22 22:44:47,710 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2014-08-22 22:44:47,710 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 629; bufvoid = 104857600
2014-08-22 22:44:47,710 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2014-08-22 22:44:47,714 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2014-08-22 22:44:47,717 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local494440237_0005_m_000000_0 is done. And is in the process of committing
2014-08-22 22:44:47,719 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2014-08-22 22:44:47,719 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local494440237_0005_m_000000_0' done.
2014-08-22 22:44:47,719 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local494440237_0005_m_000000_0
2014-08-22 22:44:47,720 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-08-22 22:44:47,720 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2014-08-22 22:44:47,720 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local494440237_0005_r_000000_0
2014-08-22 22:44:47,723 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:44:47,723 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@241ee2c5
2014-08-22 22:44:47,724 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2014-08-22 22:44:47,724 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local494440237_0005_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2014-08-22 22:44:47,726 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#5 about to shuffle output of map attempt_local494440237_0005_m_000000_0 decomp: 705 len: 709 to MEMORY
2014-08-22 22:44:47,727 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 705 bytes from map-output for attempt_local494440237_0005_m_000000_0
2014-08-22 22:44:47,727 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 705, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->705
2014-08-22 22:44:47,728 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2014-08-22 22:44:47,729 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:44:47,729 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2014-08-22 22:44:47,733 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:44:47,733 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 700 bytes
2014-08-22 22:44:47,737 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 705 bytes to disk to satisfy reduce memory limit
2014-08-22 22:44:47,738 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 709 bytes from disk
2014-08-22 22:44:47,738 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2014-08-22 22:44:47,738 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:44:47,738 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 700 bytes
2014-08-22 22:44:47,739 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:44:47,739 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.5.6
2014-08-22 22:44:47,740 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2014-08-22 22:44:47,747 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:44:47,748 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_null_true_false"]
2014-08-22 22:44:47,764 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local494440237_0005_r_000000_0 is done. And is in the process of committing
2014-08-22 22:44:47,766 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:44:47,766 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local494440237_0005_r_000000_0 is allowed to commit now
2014-08-22 22:44:47,767 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local494440237_0005_r_000000_0' to file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_null_true_false/_temporary/0/task_local494440237_0005_r_000000
2014-08-22 22:44:47,769 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2014-08-22 22:44:47,769 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local494440237_0005_r_000000_0' done.
2014-08-22 22:44:47,769 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local494440237_0005_r_000000_0
2014-08-22 22:44:47,769 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2014-08-22 22:44:47,798 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_null_true_false/_temporary
2014-08-22 22:44:47,826 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:44:47,844 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2014-08-22 22:44:47,845 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.6/31997f144a2e73eebf04d45ed31402ee30118b2/cascading-hadoop2-mr1-2.5.6.jar
2014-08-22 22:44:47,855 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-08-22 22:44:47,859 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-22 22:44:47,860 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-08-22 22:44:47,868 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort] starting
2014-08-22 22:44:47,869 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:44:47,869 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_null_true_false"]
2014-08-22 22:44:47,870 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  parallel execution is enabled: false
2014-08-22 22:44:47,870 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  starting jobs: 1
2014-08-22 22:44:47,871 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  allocating threads: 1
2014-08-22 22:44:47,872 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...sive/true_null_true_false
2014-08-22 22:44:47,873 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:44:47,875 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:44:47,902 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:44:47,923 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-08-22 22:44:47,940 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local930719013_0006
2014-08-22 22:44:47,953 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity930719013/.staging/job_local930719013_0006/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:44:47,954 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity930719013/.staging/job_local930719013_0006/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:44:47,999 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local930719013_0006/job_local930719013_0006.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:44:48,001 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local930719013_0006/job_local930719013_0006.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:44:48,002 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-08-22 22:44:48,002 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local930719013_0006
2014-08-22 22:44:48,002 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-08-22 22:44:48,002 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2014-08-22 22:44:48,003 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-08-22 22:44:48,008 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-08-22 22:44:48,008 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local930719013_0006_m_000000_0
2014-08-22 22:44:48,010 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:44:48,012 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt
2014-08-22 22:44:48,012 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@3383bff8
2014-08-22 22:44:48,013 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2014-08-22 22:44:48,014 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2014-08-22 22:44:48,038 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2014-08-22 22:44:48,039 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2014-08-22 22:44:48,039 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2014-08-22 22:44:48,039 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2014-08-22 22:44:48,040 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2014-08-22 22:44:48,042 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.5.6
2014-08-22 22:44:48,043 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2014-08-22 22:44:48,051 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:44:48,051 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:44:48,058 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2014-08-22 22:44:48,058 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2014-08-22 22:44:48,058 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2014-08-22 22:44:48,058 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 629; bufvoid = 104857600
2014-08-22 22:44:48,059 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2014-08-22 22:44:50,477 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2014-08-22 22:44:50,480 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local930719013_0006_m_000000_0 is done. And is in the process of committing
2014-08-22 22:44:50,482 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2014-08-22 22:44:50,482 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local930719013_0006_m_000000_0' done.
2014-08-22 22:44:50,483 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local930719013_0006_m_000000_0
2014-08-22 22:44:50,483 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-08-22 22:44:50,483 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2014-08-22 22:44:50,484 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local930719013_0006_r_000000_0
2014-08-22 22:44:50,487 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:44:50,488 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@261be469
2014-08-22 22:44:50,489 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2014-08-22 22:44:50,490 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local930719013_0006_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2014-08-22 22:44:50,492 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#6 about to shuffle output of map attempt_local930719013_0006_m_000000_0 decomp: 705 len: 709 to MEMORY
2014-08-22 22:44:50,493 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 705 bytes from map-output for attempt_local930719013_0006_m_000000_0
2014-08-22 22:44:50,493 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 705, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->705
2014-08-22 22:44:50,494 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2014-08-22 22:44:50,495 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:44:50,495 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2014-08-22 22:44:50,499 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:44:50,499 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 700 bytes
2014-08-22 22:44:50,501 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 705 bytes to disk to satisfy reduce memory limit
2014-08-22 22:44:50,501 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 709 bytes from disk
2014-08-22 22:44:50,501 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2014-08-22 22:44:50,501 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:44:50,502 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 700 bytes
2014-08-22 22:44:50,502 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:44:50,503 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.5.6
2014-08-22 22:44:50,503 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2014-08-22 22:44:50,511 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:44:50,512 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_null_true_false"]
2014-08-22 22:44:50,528 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local930719013_0006_r_000000_0 is done. And is in the process of committing
2014-08-22 22:44:50,530 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:44:50,530 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local930719013_0006_r_000000_0 is allowed to commit now
2014-08-22 22:44:50,531 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local930719013_0006_r_000000_0' to file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_null_true_false/_temporary/0/task_local930719013_0006_r_000000
2014-08-22 22:44:50,533 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2014-08-22 22:44:50,534 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local930719013_0006_r_000000_0' done.
2014-08-22 22:44:50,534 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local930719013_0006_r_000000_0
2014-08-22 22:44:50,535 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2014-08-22 22:44:50,558 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_null_true_false/_temporary
2014-08-22 22:44:50,585 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:44:50,611 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2014-08-22 22:44:50,611 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.6/31997f144a2e73eebf04d45ed31402ee30118b2/cascading-hadoop2-mr1-2.5.6.jar
2014-08-22 22:44:50,622 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-08-22 22:44:50,625 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-22 22:44:50,626 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-08-22 22:44:50,636 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort] starting
2014-08-22 22:44:50,636 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:44:50,636 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_false_false_false"]
2014-08-22 22:44:50,636 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  parallel execution is enabled: false
2014-08-22 22:44:50,636 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  starting jobs: 1
2014-08-22 22:44:50,637 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  allocating threads: 1
2014-08-22 22:44:50,637 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...e/false_false_false_false
2014-08-22 22:44:50,638 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:44:50,639 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:44:50,666 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:44:50,686 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-08-22 22:44:50,702 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1961705430_0007
2014-08-22 22:44:50,716 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity1961705430/.staging/job_local1961705430_0007/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:44:50,718 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity1961705430/.staging/job_local1961705430_0007/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:44:50,761 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1961705430_0007/job_local1961705430_0007.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:44:50,763 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1961705430_0007/job_local1961705430_0007.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:44:50,764 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-08-22 22:44:50,764 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-08-22 22:44:50,765 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-08-22 22:44:50,764 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local1961705430_0007
2014-08-22 22:44:50,765 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2014-08-22 22:44:50,768 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-08-22 22:44:50,768 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1961705430_0007_m_000000_0
2014-08-22 22:44:50,770 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:44:50,772 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt
2014-08-22 22:44:50,772 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@72bcecc0
2014-08-22 22:44:50,774 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2014-08-22 22:44:50,774 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2014-08-22 22:44:50,792 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2014-08-22 22:44:50,792 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2014-08-22 22:44:50,793 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2014-08-22 22:44:50,793 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2014-08-22 22:44:50,793 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2014-08-22 22:44:50,795 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.5.6
2014-08-22 22:44:50,795 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2014-08-22 22:44:50,804 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:44:50,804 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:44:50,811 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2014-08-22 22:44:50,812 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2014-08-22 22:44:50,812 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2014-08-22 22:44:50,812 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 888; bufvoid = 104857600
2014-08-22 22:44:50,812 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2014-08-22 22:44:50,817 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2014-08-22 22:44:50,819 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1961705430_0007_m_000000_0 is done. And is in the process of committing
2014-08-22 22:44:50,822 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2014-08-22 22:44:50,822 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1961705430_0007_m_000000_0' done.
2014-08-22 22:44:50,822 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1961705430_0007_m_000000_0
2014-08-22 22:44:50,822 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-08-22 22:44:50,823 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2014-08-22 22:44:50,823 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1961705430_0007_r_000000_0
2014-08-22 22:44:50,826 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:44:50,826 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@6996d898
2014-08-22 22:44:50,827 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2014-08-22 22:44:50,827 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1961705430_0007_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2014-08-22 22:44:50,829 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#7 about to shuffle output of map attempt_local1961705430_0007_m_000000_0 decomp: 964 len: 968 to MEMORY
2014-08-22 22:44:50,830 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 964 bytes from map-output for attempt_local1961705430_0007_m_000000_0
2014-08-22 22:44:50,830 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 964, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->964
2014-08-22 22:44:50,831 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2014-08-22 22:44:50,832 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:44:50,832 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2014-08-22 22:44:50,834 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:44:50,834 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2014-08-22 22:44:50,836 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 964 bytes to disk to satisfy reduce memory limit
2014-08-22 22:44:50,837 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 968 bytes from disk
2014-08-22 22:44:50,837 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2014-08-22 22:44:50,837 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:44:50,837 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2014-08-22 22:44:50,838 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:44:50,839 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.5.6
2014-08-22 22:44:50,839 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2014-08-22 22:44:50,847 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:44:50,847 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_false_false_false"]
2014-08-22 22:44:50,863 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1961705430_0007_r_000000_0 is done. And is in the process of committing
2014-08-22 22:44:50,865 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:44:50,865 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local1961705430_0007_r_000000_0 is allowed to commit now
2014-08-22 22:44:50,866 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1961705430_0007_r_000000_0' to file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_false_false_false/_temporary/0/task_local1961705430_0007_r_000000
2014-08-22 22:44:50,868 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2014-08-22 22:44:50,869 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1961705430_0007_r_000000_0' done.
2014-08-22 22:44:50,869 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1961705430_0007_r_000000_0
2014-08-22 22:44:50,869 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2014-08-22 22:44:50,896 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_false_false_false/_temporary
2014-08-22 22:44:50,924 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:44:50,941 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2014-08-22 22:44:50,942 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.6/31997f144a2e73eebf04d45ed31402ee30118b2/cascading-hadoop2-mr1-2.5.6.jar
2014-08-22 22:44:50,952 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-08-22 22:44:50,957 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-22 22:44:50,958 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-08-22 22:44:50,967 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort] starting
2014-08-22 22:44:50,967 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:44:50,968 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_false_false_false"]
2014-08-22 22:44:50,968 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  parallel execution is enabled: false
2014-08-22 22:44:50,968 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  starting jobs: 1
2014-08-22 22:44:50,968 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  allocating threads: 1
2014-08-22 22:44:50,969 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...ve/true_false_false_false
2014-08-22 22:44:50,971 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:44:50,972 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:44:50,999 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:44:51,019 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-08-22 22:44:51,035 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local2040074434_0008
2014-08-22 22:44:51,049 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity2040074434/.staging/job_local2040074434_0008/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:44:51,050 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity2040074434/.staging/job_local2040074434_0008/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:44:51,093 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2040074434_0008/job_local2040074434_0008.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:44:51,094 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2040074434_0008/job_local2040074434_0008.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:44:51,094 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-08-22 22:44:51,095 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local2040074434_0008
2014-08-22 22:44:51,095 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-08-22 22:44:51,095 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2014-08-22 22:44:51,095 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-08-22 22:44:51,098 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-08-22 22:44:51,099 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local2040074434_0008_m_000000_0
2014-08-22 22:44:51,101 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:44:51,103 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt
2014-08-22 22:44:51,103 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@73e373de
2014-08-22 22:44:51,105 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2014-08-22 22:44:51,105 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2014-08-22 22:44:51,137 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2014-08-22 22:44:51,139 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2014-08-22 22:44:51,139 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2014-08-22 22:44:51,139 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2014-08-22 22:44:51,139 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2014-08-22 22:44:51,141 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.5.6
2014-08-22 22:44:51,141 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2014-08-22 22:44:51,150 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:44:51,150 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:44:51,158 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2014-08-22 22:44:51,158 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2014-08-22 22:44:51,158 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2014-08-22 22:44:51,158 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 888; bufvoid = 104857600
2014-08-22 22:44:51,158 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2014-08-22 22:44:54,665 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2014-08-22 22:44:54,667 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local2040074434_0008_m_000000_0 is done. And is in the process of committing
2014-08-22 22:44:54,670 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2014-08-22 22:44:54,670 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local2040074434_0008_m_000000_0' done.
2014-08-22 22:44:54,670 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local2040074434_0008_m_000000_0
2014-08-22 22:44:54,671 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-08-22 22:44:54,672 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2014-08-22 22:44:54,672 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local2040074434_0008_r_000000_0
2014-08-22 22:44:54,674 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:44:54,674 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@37ff95a9
2014-08-22 22:44:54,675 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2014-08-22 22:44:54,676 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local2040074434_0008_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2014-08-22 22:44:54,678 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#8 about to shuffle output of map attempt_local2040074434_0008_m_000000_0 decomp: 964 len: 968 to MEMORY
2014-08-22 22:44:54,678 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 964 bytes from map-output for attempt_local2040074434_0008_m_000000_0
2014-08-22 22:44:54,678 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 964, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->964
2014-08-22 22:44:54,679 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2014-08-22 22:44:54,680 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:44:54,680 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2014-08-22 22:44:54,683 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:44:54,683 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2014-08-22 22:44:54,685 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 964 bytes to disk to satisfy reduce memory limit
2014-08-22 22:44:54,686 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 968 bytes from disk
2014-08-22 22:44:54,686 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2014-08-22 22:44:54,686 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:44:54,687 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2014-08-22 22:44:54,687 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:44:54,688 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.5.6
2014-08-22 22:44:54,688 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2014-08-22 22:44:54,696 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:44:54,696 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_false_false_false"]
2014-08-22 22:44:54,712 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local2040074434_0008_r_000000_0 is done. And is in the process of committing
2014-08-22 22:44:54,714 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:44:54,714 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local2040074434_0008_r_000000_0 is allowed to commit now
2014-08-22 22:44:54,715 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local2040074434_0008_r_000000_0' to file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_false_false_false/_temporary/0/task_local2040074434_0008_r_000000
2014-08-22 22:44:54,717 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2014-08-22 22:44:54,717 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local2040074434_0008_r_000000_0' done.
2014-08-22 22:44:54,717 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local2040074434_0008_r_000000_0
2014-08-22 22:44:54,717 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2014-08-22 22:44:54,741 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_false_false_false/_temporary
2014-08-22 22:44:54,769 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:44:54,789 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2014-08-22 22:44:54,789 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.6/31997f144a2e73eebf04d45ed31402ee30118b2/cascading-hadoop2-mr1-2.5.6.jar
2014-08-22 22:44:54,801 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-08-22 22:44:54,804 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-22 22:44:54,805 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-08-22 22:44:54,815 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort] starting
2014-08-22 22:44:54,816 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:44:54,816 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_true_false_false"]
2014-08-22 22:44:54,816 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  parallel execution is enabled: false
2014-08-22 22:44:54,816 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  starting jobs: 1
2014-08-22 22:44:54,817 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  allocating threads: 1
2014-08-22 22:44:54,819 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...ive/true_true_false_false
2014-08-22 22:44:54,819 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:44:54,821 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:44:54,847 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:44:54,875 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-08-22 22:44:54,892 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local531315168_0009
2014-08-22 22:44:54,906 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity531315168/.staging/job_local531315168_0009/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:44:54,907 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity531315168/.staging/job_local531315168_0009/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:44:54,952 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local531315168_0009/job_local531315168_0009.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:44:54,954 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local531315168_0009/job_local531315168_0009.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:44:54,955 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-08-22 22:44:54,956 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-08-22 22:44:54,956 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-08-22 22:44:54,956 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local531315168_0009
2014-08-22 22:44:54,957 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2014-08-22 22:44:54,959 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-08-22 22:44:54,960 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local531315168_0009_m_000000_0
2014-08-22 22:44:54,962 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:44:54,963 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt
2014-08-22 22:44:54,963 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@5c0e6396
2014-08-22 22:44:54,965 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2014-08-22 22:44:54,965 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2014-08-22 22:44:54,982 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2014-08-22 22:44:54,983 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2014-08-22 22:44:54,983 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2014-08-22 22:44:54,983 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2014-08-22 22:44:54,983 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2014-08-22 22:44:54,985 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.5.6
2014-08-22 22:44:54,986 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2014-08-22 22:44:54,994 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:44:54,995 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:44:55,001 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2014-08-22 22:44:55,001 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2014-08-22 22:44:55,002 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2014-08-22 22:44:55,002 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 888; bufvoid = 104857600
2014-08-22 22:44:55,002 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2014-08-22 22:44:59,412 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2014-08-22 22:44:59,415 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local531315168_0009_m_000000_0 is done. And is in the process of committing
2014-08-22 22:44:59,417 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2014-08-22 22:44:59,418 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local531315168_0009_m_000000_0' done.
2014-08-22 22:44:59,418 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local531315168_0009_m_000000_0
2014-08-22 22:44:59,418 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-08-22 22:44:59,419 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2014-08-22 22:44:59,420 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local531315168_0009_r_000000_0
2014-08-22 22:44:59,422 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:44:59,422 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@5ef72499
2014-08-22 22:44:59,424 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2014-08-22 22:44:59,425 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local531315168_0009_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2014-08-22 22:44:59,427 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#9 about to shuffle output of map attempt_local531315168_0009_m_000000_0 decomp: 964 len: 968 to MEMORY
2014-08-22 22:44:59,428 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 964 bytes from map-output for attempt_local531315168_0009_m_000000_0
2014-08-22 22:44:59,428 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 964, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->964
2014-08-22 22:44:59,429 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2014-08-22 22:44:59,429 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:44:59,430 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2014-08-22 22:44:59,433 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:44:59,433 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2014-08-22 22:44:59,436 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 964 bytes to disk to satisfy reduce memory limit
2014-08-22 22:44:59,436 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 968 bytes from disk
2014-08-22 22:44:59,436 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2014-08-22 22:44:59,436 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:44:59,437 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2014-08-22 22:44:59,438 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:44:59,439 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.5.6
2014-08-22 22:44:59,439 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2014-08-22 22:44:59,447 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:44:59,448 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_true_false_false"]
2014-08-22 22:44:59,463 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local531315168_0009_r_000000_0 is done. And is in the process of committing
2014-08-22 22:44:59,465 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:44:59,465 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local531315168_0009_r_000000_0 is allowed to commit now
2014-08-22 22:44:59,466 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local531315168_0009_r_000000_0' to file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_true_false_false/_temporary/0/task_local531315168_0009_r_000000
2014-08-22 22:44:59,467 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2014-08-22 22:44:59,468 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local531315168_0009_r_000000_0' done.
2014-08-22 22:44:59,468 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local531315168_0009_r_000000_0
2014-08-22 22:44:59,468 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2014-08-22 22:44:59,490 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_true_false_false/_temporary
2014-08-22 22:44:59,519 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:44:59,539 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2014-08-22 22:44:59,540 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.6/31997f144a2e73eebf04d45ed31402ee30118b2/cascading-hadoop2-mr1-2.5.6.jar
2014-08-22 22:44:59,551 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-08-22 22:44:59,554 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-22 22:44:59,555 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-08-22 22:44:59,563 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort] starting
2014-08-22 22:44:59,564 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:44:59,564 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_true_false_false"]
2014-08-22 22:44:59,564 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  parallel execution is enabled: false
2014-08-22 22:44:59,564 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  starting jobs: 1
2014-08-22 22:44:59,564 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  allocating threads: 1
2014-08-22 22:44:59,565 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...ve/false_true_false_false
2014-08-22 22:44:59,566 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:44:59,567 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:44:59,593 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:44:59,613 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-08-22 22:44:59,630 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1908563232_0010
2014-08-22 22:44:59,644 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity1908563232/.staging/job_local1908563232_0010/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:44:59,645 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity1908563232/.staging/job_local1908563232_0010/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:44:59,687 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1908563232_0010/job_local1908563232_0010.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:44:59,688 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1908563232_0010/job_local1908563232_0010.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:44:59,689 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-08-22 22:44:59,690 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-08-22 22:44:59,690 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local1908563232_0010
2014-08-22 22:44:59,690 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2014-08-22 22:44:59,690 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-08-22 22:44:59,693 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-08-22 22:44:59,693 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1908563232_0010_m_000000_0
2014-08-22 22:44:59,695 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:44:59,697 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt
2014-08-22 22:44:59,697 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@6a91ea7d
2014-08-22 22:44:59,698 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2014-08-22 22:44:59,699 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2014-08-22 22:44:59,723 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2014-08-22 22:44:59,723 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2014-08-22 22:44:59,723 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2014-08-22 22:44:59,723 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2014-08-22 22:44:59,724 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2014-08-22 22:44:59,725 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.5.6
2014-08-22 22:44:59,726 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2014-08-22 22:44:59,735 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:44:59,735 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:44:59,742 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2014-08-22 22:44:59,742 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2014-08-22 22:44:59,743 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2014-08-22 22:44:59,743 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 888; bufvoid = 104857600
2014-08-22 22:44:59,743 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2014-08-22 22:45:02,114 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2014-08-22 22:45:02,116 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1908563232_0010_m_000000_0 is done. And is in the process of committing
2014-08-22 22:45:02,118 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2014-08-22 22:45:02,118 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1908563232_0010_m_000000_0' done.
2014-08-22 22:45:02,118 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1908563232_0010_m_000000_0
2014-08-22 22:45:02,119 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-08-22 22:45:02,119 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2014-08-22 22:45:02,119 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1908563232_0010_r_000000_0
2014-08-22 22:45:02,121 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:45:02,121 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@332a4674
2014-08-22 22:45:02,122 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2014-08-22 22:45:02,124 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1908563232_0010_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2014-08-22 22:45:02,126 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#10 about to shuffle output of map attempt_local1908563232_0010_m_000000_0 decomp: 964 len: 968 to MEMORY
2014-08-22 22:45:02,126 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 964 bytes from map-output for attempt_local1908563232_0010_m_000000_0
2014-08-22 22:45:02,126 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 964, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->964
2014-08-22 22:45:02,127 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2014-08-22 22:45:02,128 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:02,128 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2014-08-22 22:45:02,131 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:45:02,131 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2014-08-22 22:45:02,133 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 964 bytes to disk to satisfy reduce memory limit
2014-08-22 22:45:02,133 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 968 bytes from disk
2014-08-22 22:45:02,134 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2014-08-22 22:45:02,134 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:45:02,134 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2014-08-22 22:45:02,135 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:02,135 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.5.6
2014-08-22 22:45:02,135 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2014-08-22 22:45:02,143 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:45:02,143 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_true_false_false"]
2014-08-22 22:45:02,159 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1908563232_0010_r_000000_0 is done. And is in the process of committing
2014-08-22 22:45:02,160 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:02,160 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local1908563232_0010_r_000000_0 is allowed to commit now
2014-08-22 22:45:02,161 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1908563232_0010_r_000000_0' to file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_true_false_false/_temporary/0/task_local1908563232_0010_r_000000
2014-08-22 22:45:02,162 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2014-08-22 22:45:02,163 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1908563232_0010_r_000000_0' done.
2014-08-22 22:45:02,163 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1908563232_0010_r_000000_0
2014-08-22 22:45:02,163 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2014-08-22 22:45:02,183 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_true_false_false/_temporary
2014-08-22 22:45:02,210 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:45:02,227 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2014-08-22 22:45:02,228 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.6/31997f144a2e73eebf04d45ed31402ee30118b2/cascading-hadoop2-mr1-2.5.6.jar
2014-08-22 22:45:02,236 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-08-22 22:45:02,238 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-22 22:45:02,239 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-08-22 22:45:02,247 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort] starting
2014-08-22 22:45:02,247 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:45:02,247 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_false_true_false"]
2014-08-22 22:45:02,247 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  parallel execution is enabled: false
2014-08-22 22:45:02,247 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  starting jobs: 1
2014-08-22 22:45:02,247 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  allocating threads: 1
2014-08-22 22:45:02,248 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...ve/false_false_true_false
2014-08-22 22:45:02,249 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:45:02,250 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:45:02,275 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:45:02,300 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-08-22 22:45:02,315 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local993487133_0011
2014-08-22 22:45:02,329 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity993487133/.staging/job_local993487133_0011/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:45:02,330 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity993487133/.staging/job_local993487133_0011/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:45:02,374 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local993487133_0011/job_local993487133_0011.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:45:02,376 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local993487133_0011/job_local993487133_0011.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:45:02,376 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-08-22 22:45:02,377 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local993487133_0011
2014-08-22 22:45:02,377 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-08-22 22:45:02,377 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2014-08-22 22:45:02,377 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-08-22 22:45:02,380 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-08-22 22:45:02,380 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local993487133_0011_m_000000_0
2014-08-22 22:45:02,382 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:45:02,384 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt
2014-08-22 22:45:02,384 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@6a472d86
2014-08-22 22:45:02,386 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2014-08-22 22:45:02,386 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2014-08-22 22:45:02,407 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2014-08-22 22:45:02,408 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2014-08-22 22:45:02,408 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2014-08-22 22:45:02,408 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2014-08-22 22:45:02,408 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2014-08-22 22:45:02,410 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.5.6
2014-08-22 22:45:02,410 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2014-08-22 22:45:02,423 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:45:02,423 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:45:02,431 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2014-08-22 22:45:02,431 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2014-08-22 22:45:02,431 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2014-08-22 22:45:02,431 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 888; bufvoid = 104857600
2014-08-22 22:45:02,431 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2014-08-22 22:45:02,437 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2014-08-22 22:45:02,439 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local993487133_0011_m_000000_0 is done. And is in the process of committing
2014-08-22 22:45:02,441 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2014-08-22 22:45:02,442 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local993487133_0011_m_000000_0' done.
2014-08-22 22:45:02,442 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local993487133_0011_m_000000_0
2014-08-22 22:45:02,442 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-08-22 22:45:02,443 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2014-08-22 22:45:02,443 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local993487133_0011_r_000000_0
2014-08-22 22:45:02,445 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:45:02,445 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@46c51ce4
2014-08-22 22:45:02,446 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2014-08-22 22:45:02,447 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local993487133_0011_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2014-08-22 22:45:02,450 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#11 about to shuffle output of map attempt_local993487133_0011_m_000000_0 decomp: 964 len: 968 to MEMORY
2014-08-22 22:45:02,451 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 964 bytes from map-output for attempt_local993487133_0011_m_000000_0
2014-08-22 22:45:02,451 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 964, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->964
2014-08-22 22:45:02,452 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2014-08-22 22:45:02,453 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:02,453 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2014-08-22 22:45:02,459 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:45:02,460 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2014-08-22 22:45:02,463 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 964 bytes to disk to satisfy reduce memory limit
2014-08-22 22:45:02,463 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 968 bytes from disk
2014-08-22 22:45:02,463 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2014-08-22 22:45:02,464 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:45:02,464 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2014-08-22 22:45:02,465 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:02,465 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.5.6
2014-08-22 22:45:02,465 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2014-08-22 22:45:02,473 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:45:02,474 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_false_true_false"]
2014-08-22 22:45:02,493 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local993487133_0011_r_000000_0 is done. And is in the process of committing
2014-08-22 22:45:02,496 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:02,496 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local993487133_0011_r_000000_0 is allowed to commit now
2014-08-22 22:45:02,497 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local993487133_0011_r_000000_0' to file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_false_true_false/_temporary/0/task_local993487133_0011_r_000000
2014-08-22 22:45:02,498 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2014-08-22 22:45:02,499 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local993487133_0011_r_000000_0' done.
2014-08-22 22:45:02,499 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local993487133_0011_r_000000_0
2014-08-22 22:45:02,499 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2014-08-22 22:45:02,527 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_false_true_false/_temporary
2014-08-22 22:45:02,555 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:45:02,573 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2014-08-22 22:45:02,574 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.6/31997f144a2e73eebf04d45ed31402ee30118b2/cascading-hadoop2-mr1-2.5.6.jar
2014-08-22 22:45:02,583 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-08-22 22:45:02,585 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-22 22:45:02,586 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-08-22 22:45:02,594 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort] starting
2014-08-22 22:45:02,594 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:45:02,594 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_false_true_false"]
2014-08-22 22:45:02,594 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  parallel execution is enabled: false
2014-08-22 22:45:02,595 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  starting jobs: 1
2014-08-22 22:45:02,595 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  allocating threads: 1
2014-08-22 22:45:02,595 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...ive/true_false_true_false
2014-08-22 22:45:02,596 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:45:02,597 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:45:02,624 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:45:02,645 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-08-22 22:45:02,661 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local968141048_0012
2014-08-22 22:45:02,676 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity968141048/.staging/job_local968141048_0012/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:45:02,677 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity968141048/.staging/job_local968141048_0012/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:45:02,721 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local968141048_0012/job_local968141048_0012.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:45:02,722 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local968141048_0012/job_local968141048_0012.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:45:02,722 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-08-22 22:45:02,723 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local968141048_0012
2014-08-22 22:45:02,723 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-08-22 22:45:02,723 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2014-08-22 22:45:02,723 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-08-22 22:45:02,726 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-08-22 22:45:02,726 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local968141048_0012_m_000000_0
2014-08-22 22:45:02,728 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:45:02,730 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt
2014-08-22 22:45:02,730 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@79a1ea46
2014-08-22 22:45:02,731 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2014-08-22 22:45:02,731 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2014-08-22 22:45:02,755 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2014-08-22 22:45:02,755 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2014-08-22 22:45:02,755 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2014-08-22 22:45:02,755 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2014-08-22 22:45:02,755 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2014-08-22 22:45:02,757 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.5.6
2014-08-22 22:45:02,757 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2014-08-22 22:45:02,766 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:45:02,766 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:45:02,772 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2014-08-22 22:45:02,772 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2014-08-22 22:45:02,772 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2014-08-22 22:45:02,773 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 888; bufvoid = 104857600
2014-08-22 22:45:02,773 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2014-08-22 22:45:06,282 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2014-08-22 22:45:06,285 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local968141048_0012_m_000000_0 is done. And is in the process of committing
2014-08-22 22:45:06,287 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2014-08-22 22:45:06,287 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local968141048_0012_m_000000_0' done.
2014-08-22 22:45:06,287 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local968141048_0012_m_000000_0
2014-08-22 22:45:06,287 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-08-22 22:45:06,288 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2014-08-22 22:45:06,288 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local968141048_0012_r_000000_0
2014-08-22 22:45:06,290 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:45:06,290 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@2e518924
2014-08-22 22:45:06,292 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2014-08-22 22:45:06,293 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local968141048_0012_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2014-08-22 22:45:06,294 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#12 about to shuffle output of map attempt_local968141048_0012_m_000000_0 decomp: 964 len: 968 to MEMORY
2014-08-22 22:45:06,295 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 964 bytes from map-output for attempt_local968141048_0012_m_000000_0
2014-08-22 22:45:06,295 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 964, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->964
2014-08-22 22:45:06,296 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2014-08-22 22:45:06,297 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:06,297 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2014-08-22 22:45:06,300 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:45:06,300 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2014-08-22 22:45:06,302 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 964 bytes to disk to satisfy reduce memory limit
2014-08-22 22:45:06,302 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 968 bytes from disk
2014-08-22 22:45:06,302 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2014-08-22 22:45:06,302 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:45:06,303 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2014-08-22 22:45:06,303 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:06,304 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.5.6
2014-08-22 22:45:06,304 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2014-08-22 22:45:06,312 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:45:06,312 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_false_true_false"]
2014-08-22 22:45:06,328 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local968141048_0012_r_000000_0 is done. And is in the process of committing
2014-08-22 22:45:06,329 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:06,329 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local968141048_0012_r_000000_0 is allowed to commit now
2014-08-22 22:45:06,330 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local968141048_0012_r_000000_0' to file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_false_true_false/_temporary/0/task_local968141048_0012_r_000000
2014-08-22 22:45:06,331 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2014-08-22 22:45:06,332 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local968141048_0012_r_000000_0' done.
2014-08-22 22:45:06,332 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local968141048_0012_r_000000_0
2014-08-22 22:45:06,332 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2014-08-22 22:45:06,351 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_false_true_false/_temporary
2014-08-22 22:45:06,377 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:45:06,396 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2014-08-22 22:45:06,396 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.6/31997f144a2e73eebf04d45ed31402ee30118b2/cascading-hadoop2-mr1-2.5.6.jar
2014-08-22 22:45:06,405 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-08-22 22:45:06,407 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-22 22:45:06,407 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-08-22 22:45:06,414 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort] starting
2014-08-22 22:45:06,415 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:45:06,415 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_true_true_false"]
2014-08-22 22:45:06,415 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  parallel execution is enabled: false
2014-08-22 22:45:06,415 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  starting jobs: 1
2014-08-22 22:45:06,415 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  allocating threads: 1
2014-08-22 22:45:06,417 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...sive/true_true_true_false
2014-08-22 22:45:06,418 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:45:06,419 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:45:06,443 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:45:06,462 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-08-22 22:45:06,483 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local2010945203_0013
2014-08-22 22:45:06,497 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity2010945203/.staging/job_local2010945203_0013/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:45:06,498 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity2010945203/.staging/job_local2010945203_0013/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:45:06,538 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2010945203_0013/job_local2010945203_0013.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:45:06,539 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2010945203_0013/job_local2010945203_0013.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:45:06,540 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-08-22 22:45:06,540 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-08-22 22:45:06,540 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-08-22 22:45:06,540 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local2010945203_0013
2014-08-22 22:45:06,541 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2014-08-22 22:45:06,544 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-08-22 22:45:06,544 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local2010945203_0013_m_000000_0
2014-08-22 22:45:06,546 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:45:06,547 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt
2014-08-22 22:45:06,548 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@30407e62
2014-08-22 22:45:06,549 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2014-08-22 22:45:06,549 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2014-08-22 22:45:06,567 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2014-08-22 22:45:06,567 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2014-08-22 22:45:06,567 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2014-08-22 22:45:06,567 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2014-08-22 22:45:06,567 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2014-08-22 22:45:06,569 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.5.6
2014-08-22 22:45:06,569 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2014-08-22 22:45:06,578 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:45:06,578 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:45:06,584 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2014-08-22 22:45:06,584 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2014-08-22 22:45:06,584 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2014-08-22 22:45:06,585 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 888; bufvoid = 104857600
2014-08-22 22:45:06,585 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2014-08-22 22:45:11,020 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2014-08-22 22:45:11,023 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local2010945203_0013_m_000000_0 is done. And is in the process of committing
2014-08-22 22:45:11,024 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2014-08-22 22:45:11,025 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local2010945203_0013_m_000000_0' done.
2014-08-22 22:45:11,025 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local2010945203_0013_m_000000_0
2014-08-22 22:45:11,025 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-08-22 22:45:11,026 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2014-08-22 22:45:11,026 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local2010945203_0013_r_000000_0
2014-08-22 22:45:11,028 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:45:11,028 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@70910539
2014-08-22 22:45:11,029 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2014-08-22 22:45:11,030 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local2010945203_0013_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2014-08-22 22:45:11,032 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#13 about to shuffle output of map attempt_local2010945203_0013_m_000000_0 decomp: 964 len: 968 to MEMORY
2014-08-22 22:45:11,033 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 964 bytes from map-output for attempt_local2010945203_0013_m_000000_0
2014-08-22 22:45:11,033 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 964, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->964
2014-08-22 22:45:11,035 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2014-08-22 22:45:11,036 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:11,036 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2014-08-22 22:45:11,039 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:45:11,039 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2014-08-22 22:45:11,041 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 964 bytes to disk to satisfy reduce memory limit
2014-08-22 22:45:11,042 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 968 bytes from disk
2014-08-22 22:45:11,042 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2014-08-22 22:45:11,042 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:45:11,042 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2014-08-22 22:45:11,043 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:11,044 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.5.6
2014-08-22 22:45:11,044 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2014-08-22 22:45:11,051 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:45:11,052 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_true_true_false"]
2014-08-22 22:45:11,067 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local2010945203_0013_r_000000_0 is done. And is in the process of committing
2014-08-22 22:45:11,068 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:11,068 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local2010945203_0013_r_000000_0 is allowed to commit now
2014-08-22 22:45:11,069 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local2010945203_0013_r_000000_0' to file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_true_true_false/_temporary/0/task_local2010945203_0013_r_000000
2014-08-22 22:45:11,071 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2014-08-22 22:45:11,071 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local2010945203_0013_r_000000_0' done.
2014-08-22 22:45:11,072 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local2010945203_0013_r_000000_0
2014-08-22 22:45:11,072 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2014-08-22 22:45:11,092 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_true_true_false/_temporary
2014-08-22 22:45:11,119 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:45:11,136 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2014-08-22 22:45:11,137 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.6/31997f144a2e73eebf04d45ed31402ee30118b2/cascading-hadoop2-mr1-2.5.6.jar
2014-08-22 22:45:11,145 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-08-22 22:45:11,147 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-22 22:45:11,147 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-08-22 22:45:11,155 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort] starting
2014-08-22 22:45:11,156 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:45:11,156 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_true_true_false"]
2014-08-22 22:45:11,157 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  parallel execution is enabled: false
2014-08-22 22:45:11,157 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  starting jobs: 1
2014-08-22 22:45:11,158 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  allocating threads: 1
2014-08-22 22:45:11,159 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...ive/false_true_true_false
2014-08-22 22:45:11,160 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:45:11,161 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:45:11,185 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:45:11,203 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-08-22 22:45:11,218 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1288857523_0014
2014-08-22 22:45:11,231 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity1288857523/.staging/job_local1288857523_0014/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:45:11,232 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity1288857523/.staging/job_local1288857523_0014/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:45:11,272 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1288857523_0014/job_local1288857523_0014.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:45:11,273 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1288857523_0014/job_local1288857523_0014.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:45:11,274 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-08-22 22:45:11,274 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local1288857523_0014
2014-08-22 22:45:11,274 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2014-08-22 22:45:11,275 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-08-22 22:45:11,275 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-08-22 22:45:11,278 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-08-22 22:45:11,278 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1288857523_0014_m_000000_0
2014-08-22 22:45:11,280 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:45:11,282 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt
2014-08-22 22:45:11,282 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@3c5310e4
2014-08-22 22:45:11,284 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2014-08-22 22:45:11,284 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2014-08-22 22:45:11,305 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2014-08-22 22:45:11,305 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2014-08-22 22:45:11,306 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2014-08-22 22:45:11,306 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2014-08-22 22:45:11,306 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2014-08-22 22:45:11,308 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.5.6
2014-08-22 22:45:11,308 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2014-08-22 22:45:11,316 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:45:11,316 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:45:11,323 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2014-08-22 22:45:11,323 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2014-08-22 22:45:11,323 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2014-08-22 22:45:11,323 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 888; bufvoid = 104857600
2014-08-22 22:45:11,323 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2014-08-22 22:45:13,593 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2014-08-22 22:45:13,595 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1288857523_0014_m_000000_0 is done. And is in the process of committing
2014-08-22 22:45:13,597 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2014-08-22 22:45:13,597 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1288857523_0014_m_000000_0' done.
2014-08-22 22:45:13,597 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1288857523_0014_m_000000_0
2014-08-22 22:45:13,598 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-08-22 22:45:13,598 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2014-08-22 22:45:13,599 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1288857523_0014_r_000000_0
2014-08-22 22:45:13,601 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:45:13,601 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@3d8b697e
2014-08-22 22:45:13,602 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2014-08-22 22:45:13,603 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1288857523_0014_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2014-08-22 22:45:13,605 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#14 about to shuffle output of map attempt_local1288857523_0014_m_000000_0 decomp: 964 len: 968 to MEMORY
2014-08-22 22:45:13,605 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 964 bytes from map-output for attempt_local1288857523_0014_m_000000_0
2014-08-22 22:45:13,606 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 964, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->964
2014-08-22 22:45:13,606 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2014-08-22 22:45:13,607 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:13,608 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2014-08-22 22:45:13,610 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:45:13,610 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2014-08-22 22:45:13,612 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 964 bytes to disk to satisfy reduce memory limit
2014-08-22 22:45:13,613 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 968 bytes from disk
2014-08-22 22:45:13,613 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2014-08-22 22:45:13,613 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:45:13,613 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2014-08-22 22:45:13,614 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:13,614 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.5.6
2014-08-22 22:45:13,614 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2014-08-22 22:45:13,622 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:45:13,622 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_true_true_false"]
2014-08-22 22:45:13,637 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1288857523_0014_r_000000_0 is done. And is in the process of committing
2014-08-22 22:45:13,639 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:13,639 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local1288857523_0014_r_000000_0 is allowed to commit now
2014-08-22 22:45:13,640 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1288857523_0014_r_000000_0' to file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_true_true_false/_temporary/0/task_local1288857523_0014_r_000000
2014-08-22 22:45:13,641 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2014-08-22 22:45:13,641 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1288857523_0014_r_000000_0' done.
2014-08-22 22:45:13,641 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1288857523_0014_r_000000_0
2014-08-22 22:45:13,641 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2014-08-22 22:45:13,666 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_true_true_false/_temporary
2014-08-22 22:45:13,693 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:45:13,710 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2014-08-22 22:45:13,711 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.6/31997f144a2e73eebf04d45ed31402ee30118b2/cascading-hadoop2-mr1-2.5.6.jar
2014-08-22 22:45:13,718 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-08-22 22:45:13,721 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-22 22:45:13,721 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-08-22 22:45:13,727 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort] starting
2014-08-22 22:45:13,728 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:45:13,728 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_null_false_true"]
2014-08-22 22:45:13,728 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  parallel execution is enabled: false
2014-08-22 22:45:13,728 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  starting jobs: 1
2014-08-22 22:45:13,728 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  allocating threads: 1
2014-08-22 22:45:13,731 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...ive/false_null_false_true
2014-08-22 22:45:13,731 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:45:13,733 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:45:13,757 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:45:13,782 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-08-22 22:45:13,796 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local849356805_0015
2014-08-22 22:45:13,810 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity849356805/.staging/job_local849356805_0015/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:45:13,811 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity849356805/.staging/job_local849356805_0015/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:45:13,850 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local849356805_0015/job_local849356805_0015.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:45:13,851 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local849356805_0015/job_local849356805_0015.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:45:13,852 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-08-22 22:45:13,852 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local849356805_0015
2014-08-22 22:45:13,852 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-08-22 22:45:13,852 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2014-08-22 22:45:13,853 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-08-22 22:45:13,855 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-08-22 22:45:13,856 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local849356805_0015_m_000000_0
2014-08-22 22:45:13,857 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:45:13,859 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt
2014-08-22 22:45:13,860 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@655fd43
2014-08-22 22:45:13,861 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2014-08-22 22:45:13,861 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2014-08-22 22:45:13,879 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2014-08-22 22:45:13,879 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2014-08-22 22:45:13,880 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2014-08-22 22:45:13,880 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2014-08-22 22:45:13,880 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2014-08-22 22:45:13,882 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.5.6
2014-08-22 22:45:13,882 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2014-08-22 22:45:13,890 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:45:13,891 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:45:13,897 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2014-08-22 22:45:13,897 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2014-08-22 22:45:13,898 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2014-08-22 22:45:13,898 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 629; bufvoid = 104857600
2014-08-22 22:45:13,898 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2014-08-22 22:45:13,902 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2014-08-22 22:45:13,904 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local849356805_0015_m_000000_0 is done. And is in the process of committing
2014-08-22 22:45:13,906 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2014-08-22 22:45:13,906 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local849356805_0015_m_000000_0' done.
2014-08-22 22:45:13,907 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local849356805_0015_m_000000_0
2014-08-22 22:45:13,907 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-08-22 22:45:13,908 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2014-08-22 22:45:13,908 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local849356805_0015_r_000000_0
2014-08-22 22:45:13,910 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:45:13,910 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@5626b468
2014-08-22 22:45:13,911 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2014-08-22 22:45:13,912 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local849356805_0015_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2014-08-22 22:45:13,914 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#15 about to shuffle output of map attempt_local849356805_0015_m_000000_0 decomp: 705 len: 709 to MEMORY
2014-08-22 22:45:13,915 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 705 bytes from map-output for attempt_local849356805_0015_m_000000_0
2014-08-22 22:45:13,915 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 705, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->705
2014-08-22 22:45:13,915 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2014-08-22 22:45:13,917 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:13,917 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2014-08-22 22:45:13,919 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:45:13,920 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 700 bytes
2014-08-22 22:45:13,922 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 705 bytes to disk to satisfy reduce memory limit
2014-08-22 22:45:13,922 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 709 bytes from disk
2014-08-22 22:45:13,923 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2014-08-22 22:45:13,923 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:45:13,924 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 700 bytes
2014-08-22 22:45:13,924 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:13,925 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.5.6
2014-08-22 22:45:13,925 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2014-08-22 22:45:13,932 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:45:13,933 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_null_false_true"]
2014-08-22 22:45:13,948 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local849356805_0015_r_000000_0 is done. And is in the process of committing
2014-08-22 22:45:13,950 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:13,950 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local849356805_0015_r_000000_0 is allowed to commit now
2014-08-22 22:45:13,951 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local849356805_0015_r_000000_0' to file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_null_false_true/_temporary/0/task_local849356805_0015_r_000000
2014-08-22 22:45:13,952 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2014-08-22 22:45:13,952 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local849356805_0015_r_000000_0' done.
2014-08-22 22:45:13,952 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local849356805_0015_r_000000_0
2014-08-22 22:45:13,953 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2014-08-22 22:45:13,971 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_null_false_true/_temporary
2014-08-22 22:45:13,998 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:45:14,015 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2014-08-22 22:45:14,016 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.6/31997f144a2e73eebf04d45ed31402ee30118b2/cascading-hadoop2-mr1-2.5.6.jar
2014-08-22 22:45:14,025 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-08-22 22:45:14,027 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-22 22:45:14,027 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-08-22 22:45:14,033 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort] starting
2014-08-22 22:45:14,034 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:45:14,034 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_null_false_true"]
2014-08-22 22:45:14,034 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  parallel execution is enabled: false
2014-08-22 22:45:14,035 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  starting jobs: 1
2014-08-22 22:45:14,035 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  allocating threads: 1
2014-08-22 22:45:14,036 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...sive/true_null_false_true
2014-08-22 22:45:14,036 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:45:14,037 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:45:14,061 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:45:14,079 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-08-22 22:45:14,094 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local256692001_0016
2014-08-22 22:45:14,109 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity256692001/.staging/job_local256692001_0016/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:45:14,110 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity256692001/.staging/job_local256692001_0016/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:45:14,149 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local256692001_0016/job_local256692001_0016.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:45:14,150 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local256692001_0016/job_local256692001_0016.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:45:14,151 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-08-22 22:45:14,151 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-08-22 22:45:14,152 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-08-22 22:45:14,152 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local256692001_0016
2014-08-22 22:45:14,152 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2014-08-22 22:45:14,154 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-08-22 22:45:14,154 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local256692001_0016_m_000000_0
2014-08-22 22:45:14,156 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:45:14,158 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt
2014-08-22 22:45:14,158 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@2208fc73
2014-08-22 22:45:14,159 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2014-08-22 22:45:14,159 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2014-08-22 22:45:14,183 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2014-08-22 22:45:14,183 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2014-08-22 22:45:14,183 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2014-08-22 22:45:14,183 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2014-08-22 22:45:14,183 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2014-08-22 22:45:14,185 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.5.6
2014-08-22 22:45:14,185 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2014-08-22 22:45:14,197 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:45:14,197 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:45:14,203 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2014-08-22 22:45:14,203 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2014-08-22 22:45:14,204 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2014-08-22 22:45:14,204 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 629; bufvoid = 104857600
2014-08-22 22:45:14,204 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2014-08-22 22:45:14,207 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2014-08-22 22:45:14,209 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local256692001_0016_m_000000_0 is done. And is in the process of committing
2014-08-22 22:45:14,211 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2014-08-22 22:45:14,211 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local256692001_0016_m_000000_0' done.
2014-08-22 22:45:14,211 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local256692001_0016_m_000000_0
2014-08-22 22:45:14,212 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-08-22 22:45:14,212 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2014-08-22 22:45:14,212 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local256692001_0016_r_000000_0
2014-08-22 22:45:14,214 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:45:14,215 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@1b549b82
2014-08-22 22:45:14,215 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2014-08-22 22:45:14,216 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local256692001_0016_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2014-08-22 22:45:14,219 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#16 about to shuffle output of map attempt_local256692001_0016_m_000000_0 decomp: 705 len: 709 to MEMORY
2014-08-22 22:45:14,219 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 705 bytes from map-output for attempt_local256692001_0016_m_000000_0
2014-08-22 22:45:14,219 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 705, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->705
2014-08-22 22:45:14,220 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2014-08-22 22:45:14,221 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:14,221 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2014-08-22 22:45:14,226 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:45:14,226 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 700 bytes
2014-08-22 22:45:14,228 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 705 bytes to disk to satisfy reduce memory limit
2014-08-22 22:45:14,228 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 709 bytes from disk
2014-08-22 22:45:14,228 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2014-08-22 22:45:14,229 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:45:14,230 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 700 bytes
2014-08-22 22:45:14,230 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:14,231 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.5.6
2014-08-22 22:45:14,231 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2014-08-22 22:45:14,238 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:45:14,239 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_null_false_true"]
2014-08-22 22:45:14,253 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local256692001_0016_r_000000_0 is done. And is in the process of committing
2014-08-22 22:45:14,254 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:14,254 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local256692001_0016_r_000000_0 is allowed to commit now
2014-08-22 22:45:14,255 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local256692001_0016_r_000000_0' to file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_null_false_true/_temporary/0/task_local256692001_0016_r_000000
2014-08-22 22:45:14,256 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2014-08-22 22:45:14,256 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local256692001_0016_r_000000_0' done.
2014-08-22 22:45:14,257 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local256692001_0016_r_000000_0
2014-08-22 22:45:14,257 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2014-08-22 22:45:14,282 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_null_false_true/_temporary
2014-08-22 22:45:14,309 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:45:14,328 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2014-08-22 22:45:14,329 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.6/31997f144a2e73eebf04d45ed31402ee30118b2/cascading-hadoop2-mr1-2.5.6.jar
2014-08-22 22:45:14,338 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-08-22 22:45:14,340 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-22 22:45:14,341 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-08-22 22:45:14,346 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort] starting
2014-08-22 22:45:14,347 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:45:14,347 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_null_true_true"]
2014-08-22 22:45:14,347 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  parallel execution is enabled: false
2014-08-22 22:45:14,347 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  starting jobs: 1
2014-08-22 22:45:14,347 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  allocating threads: 1
2014-08-22 22:45:14,349 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...sive/false_null_true_true
2014-08-22 22:45:14,350 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:45:14,351 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:45:14,375 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:45:14,393 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-08-22 22:45:14,408 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local724381445_0017
2014-08-22 22:45:14,423 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity724381445/.staging/job_local724381445_0017/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:45:14,424 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity724381445/.staging/job_local724381445_0017/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:45:14,465 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local724381445_0017/job_local724381445_0017.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:45:14,466 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local724381445_0017/job_local724381445_0017.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:45:14,467 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-08-22 22:45:14,469 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-08-22 22:45:14,469 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local724381445_0017
2014-08-22 22:45:14,469 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2014-08-22 22:45:14,469 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-08-22 22:45:14,472 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-08-22 22:45:14,472 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local724381445_0017_m_000000_0
2014-08-22 22:45:14,474 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:45:14,475 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt
2014-08-22 22:45:14,475 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@5ba440f3
2014-08-22 22:45:14,476 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2014-08-22 22:45:14,476 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2014-08-22 22:45:14,500 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2014-08-22 22:45:14,500 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2014-08-22 22:45:14,500 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2014-08-22 22:45:14,500 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2014-08-22 22:45:14,500 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2014-08-22 22:45:14,501 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.5.6
2014-08-22 22:45:14,502 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2014-08-22 22:45:14,509 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:45:14,509 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:45:14,515 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2014-08-22 22:45:14,515 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2014-08-22 22:45:14,516 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2014-08-22 22:45:14,516 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 629; bufvoid = 104857600
2014-08-22 22:45:14,516 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2014-08-22 22:45:14,519 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2014-08-22 22:45:14,521 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local724381445_0017_m_000000_0 is done. And is in the process of committing
2014-08-22 22:45:14,523 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2014-08-22 22:45:14,523 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local724381445_0017_m_000000_0' done.
2014-08-22 22:45:14,523 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local724381445_0017_m_000000_0
2014-08-22 22:45:14,523 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-08-22 22:45:14,524 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2014-08-22 22:45:14,524 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local724381445_0017_r_000000_0
2014-08-22 22:45:14,525 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:45:14,526 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@4a9fed16
2014-08-22 22:45:14,526 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2014-08-22 22:45:14,527 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local724381445_0017_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2014-08-22 22:45:14,529 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#17 about to shuffle output of map attempt_local724381445_0017_m_000000_0 decomp: 705 len: 709 to MEMORY
2014-08-22 22:45:14,529 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 705 bytes from map-output for attempt_local724381445_0017_m_000000_0
2014-08-22 22:45:14,530 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 705, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->705
2014-08-22 22:45:14,530 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2014-08-22 22:45:14,531 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:14,531 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2014-08-22 22:45:14,533 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:45:14,533 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 700 bytes
2014-08-22 22:45:14,535 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 705 bytes to disk to satisfy reduce memory limit
2014-08-22 22:45:14,536 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 709 bytes from disk
2014-08-22 22:45:14,536 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2014-08-22 22:45:14,536 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:45:14,536 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 700 bytes
2014-08-22 22:45:14,537 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:14,537 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.5.6
2014-08-22 22:45:14,537 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2014-08-22 22:45:14,544 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:45:14,544 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_null_true_true"]
2014-08-22 22:45:14,558 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local724381445_0017_r_000000_0 is done. And is in the process of committing
2014-08-22 22:45:14,559 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:14,559 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local724381445_0017_r_000000_0 is allowed to commit now
2014-08-22 22:45:14,560 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local724381445_0017_r_000000_0' to file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_null_true_true/_temporary/0/task_local724381445_0017_r_000000
2014-08-22 22:45:14,561 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2014-08-22 22:45:14,561 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local724381445_0017_r_000000_0' done.
2014-08-22 22:45:14,562 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local724381445_0017_r_000000_0
2014-08-22 22:45:14,562 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2014-08-22 22:45:14,578 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_null_true_true/_temporary
2014-08-22 22:45:14,604 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:45:14,621 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2014-08-22 22:45:14,622 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.6/31997f144a2e73eebf04d45ed31402ee30118b2/cascading-hadoop2-mr1-2.5.6.jar
2014-08-22 22:45:14,630 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-08-22 22:45:14,632 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-22 22:45:14,632 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-08-22 22:45:14,637 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort] starting
2014-08-22 22:45:14,638 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:45:14,638 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_null_true_true"]
2014-08-22 22:45:14,638 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  parallel execution is enabled: false
2014-08-22 22:45:14,638 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  starting jobs: 1
2014-08-22 22:45:14,638 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  allocating threads: 1
2014-08-22 22:45:14,639 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...nsive/true_null_true_true
2014-08-22 22:45:14,639 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:45:14,640 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:45:14,664 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:45:14,682 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-08-22 22:45:14,697 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local76459608_0018
2014-08-22 22:45:14,711 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity76459608/.staging/job_local76459608_0018/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:45:14,713 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity76459608/.staging/job_local76459608_0018/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:45:14,754 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local76459608_0018/job_local76459608_0018.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:45:14,756 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local76459608_0018/job_local76459608_0018.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:45:14,756 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-08-22 22:45:14,756 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local76459608_0018
2014-08-22 22:45:14,757 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-08-22 22:45:14,757 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2014-08-22 22:45:14,757 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-08-22 22:45:14,760 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-08-22 22:45:14,760 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local76459608_0018_m_000000_0
2014-08-22 22:45:14,762 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:45:14,763 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt
2014-08-22 22:45:14,763 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@278efc0c
2014-08-22 22:45:14,764 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2014-08-22 22:45:14,765 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2014-08-22 22:45:14,787 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2014-08-22 22:45:14,788 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2014-08-22 22:45:14,788 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2014-08-22 22:45:14,788 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2014-08-22 22:45:14,788 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2014-08-22 22:45:14,790 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.5.6
2014-08-22 22:45:14,790 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2014-08-22 22:45:14,801 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:45:14,801 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:45:14,807 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2014-08-22 22:45:14,808 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2014-08-22 22:45:14,808 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2014-08-22 22:45:14,808 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 629; bufvoid = 104857600
2014-08-22 22:45:14,808 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2014-08-22 22:45:14,811 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2014-08-22 22:45:14,813 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local76459608_0018_m_000000_0 is done. And is in the process of committing
2014-08-22 22:45:14,815 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2014-08-22 22:45:14,815 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local76459608_0018_m_000000_0' done.
2014-08-22 22:45:14,815 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local76459608_0018_m_000000_0
2014-08-22 22:45:14,815 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-08-22 22:45:14,816 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2014-08-22 22:45:14,816 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local76459608_0018_r_000000_0
2014-08-22 22:45:14,818 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:45:14,818 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@48cac17
2014-08-22 22:45:14,819 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2014-08-22 22:45:14,820 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local76459608_0018_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2014-08-22 22:45:14,821 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#18 about to shuffle output of map attempt_local76459608_0018_m_000000_0 decomp: 705 len: 709 to MEMORY
2014-08-22 22:45:14,822 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 705 bytes from map-output for attempt_local76459608_0018_m_000000_0
2014-08-22 22:45:14,822 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 705, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->705
2014-08-22 22:45:14,823 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2014-08-22 22:45:14,824 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:14,825 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2014-08-22 22:45:14,827 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:45:14,827 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 700 bytes
2014-08-22 22:45:14,829 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 705 bytes to disk to satisfy reduce memory limit
2014-08-22 22:45:14,829 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 709 bytes from disk
2014-08-22 22:45:14,829 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2014-08-22 22:45:14,830 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:45:14,830 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 700 bytes
2014-08-22 22:45:14,831 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:14,831 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.5.6
2014-08-22 22:45:14,832 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2014-08-22 22:45:14,839 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:45:14,839 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_null_true_true"]
2014-08-22 22:45:14,855 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local76459608_0018_r_000000_0 is done. And is in the process of committing
2014-08-22 22:45:14,856 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:14,856 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local76459608_0018_r_000000_0 is allowed to commit now
2014-08-22 22:45:14,857 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local76459608_0018_r_000000_0' to file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_null_true_true/_temporary/0/task_local76459608_0018_r_000000
2014-08-22 22:45:14,858 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2014-08-22 22:45:14,859 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local76459608_0018_r_000000_0' done.
2014-08-22 22:45:14,859 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local76459608_0018_r_000000_0
2014-08-22 22:45:14,859 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2014-08-22 22:45:14,876 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_null_true_true/_temporary
2014-08-22 22:45:14,903 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:45:14,920 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2014-08-22 22:45:14,920 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.6/31997f144a2e73eebf04d45ed31402ee30118b2/cascading-hadoop2-mr1-2.5.6.jar
2014-08-22 22:45:14,927 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-08-22 22:45:14,929 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-22 22:45:14,929 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-08-22 22:45:14,934 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort] starting
2014-08-22 22:45:14,934 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:45:14,934 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_false_false_true"]
2014-08-22 22:45:14,934 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  parallel execution is enabled: false
2014-08-22 22:45:14,934 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  starting jobs: 1
2014-08-22 22:45:14,935 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  allocating threads: 1
2014-08-22 22:45:14,936 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...ve/false_false_false_true
2014-08-22 22:45:14,937 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:45:14,938 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:45:14,961 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:45:14,979 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-08-22 22:45:14,994 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1460303685_0019
2014-08-22 22:45:15,008 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity1460303685/.staging/job_local1460303685_0019/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:45:15,009 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity1460303685/.staging/job_local1460303685_0019/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:45:15,049 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1460303685_0019/job_local1460303685_0019.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:45:15,050 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1460303685_0019/job_local1460303685_0019.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:45:15,051 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-08-22 22:45:15,051 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local1460303685_0019
2014-08-22 22:45:15,052 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2014-08-22 22:45:15,052 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-08-22 22:45:15,052 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-08-22 22:45:15,055 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-08-22 22:45:15,055 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1460303685_0019_m_000000_0
2014-08-22 22:45:15,057 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:45:15,058 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt
2014-08-22 22:45:15,058 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@1529d183
2014-08-22 22:45:15,059 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2014-08-22 22:45:15,060 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2014-08-22 22:45:15,083 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2014-08-22 22:45:15,083 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2014-08-22 22:45:15,083 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2014-08-22 22:45:15,083 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2014-08-22 22:45:15,083 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2014-08-22 22:45:15,084 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.5.6
2014-08-22 22:45:15,084 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2014-08-22 22:45:15,093 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:45:15,094 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:45:15,102 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2014-08-22 22:45:15,102 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2014-08-22 22:45:15,102 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2014-08-22 22:45:15,102 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 888; bufvoid = 104857600
2014-08-22 22:45:15,102 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2014-08-22 22:45:15,107 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2014-08-22 22:45:15,109 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1460303685_0019_m_000000_0 is done. And is in the process of committing
2014-08-22 22:45:15,111 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2014-08-22 22:45:15,111 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1460303685_0019_m_000000_0' done.
2014-08-22 22:45:15,111 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1460303685_0019_m_000000_0
2014-08-22 22:45:15,111 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-08-22 22:45:15,112 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2014-08-22 22:45:15,112 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1460303685_0019_r_000000_0
2014-08-22 22:45:15,114 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:45:15,114 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@2f012501
2014-08-22 22:45:15,115 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2014-08-22 22:45:15,116 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1460303685_0019_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2014-08-22 22:45:15,118 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#19 about to shuffle output of map attempt_local1460303685_0019_m_000000_0 decomp: 964 len: 968 to MEMORY
2014-08-22 22:45:15,118 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 964 bytes from map-output for attempt_local1460303685_0019_m_000000_0
2014-08-22 22:45:15,119 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 964, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->964
2014-08-22 22:45:15,119 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2014-08-22 22:45:15,121 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:15,122 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2014-08-22 22:45:15,125 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:45:15,125 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2014-08-22 22:45:15,127 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 964 bytes to disk to satisfy reduce memory limit
2014-08-22 22:45:15,127 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 968 bytes from disk
2014-08-22 22:45:15,127 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2014-08-22 22:45:15,128 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:45:15,130 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2014-08-22 22:45:15,131 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:15,131 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.5.6
2014-08-22 22:45:15,132 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2014-08-22 22:45:15,139 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:45:15,139 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_false_false_true"]
2014-08-22 22:45:15,152 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1460303685_0019_r_000000_0 is done. And is in the process of committing
2014-08-22 22:45:15,153 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:15,153 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local1460303685_0019_r_000000_0 is allowed to commit now
2014-08-22 22:45:15,154 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1460303685_0019_r_000000_0' to file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_false_false_true/_temporary/0/task_local1460303685_0019_r_000000
2014-08-22 22:45:15,155 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2014-08-22 22:45:15,156 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1460303685_0019_r_000000_0' done.
2014-08-22 22:45:15,156 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1460303685_0019_r_000000_0
2014-08-22 22:45:15,156 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2014-08-22 22:45:15,172 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_false_false_true/_temporary
2014-08-22 22:45:15,198 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:45:15,217 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2014-08-22 22:45:15,218 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.6/31997f144a2e73eebf04d45ed31402ee30118b2/cascading-hadoop2-mr1-2.5.6.jar
2014-08-22 22:45:15,225 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-08-22 22:45:15,228 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-22 22:45:15,229 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-08-22 22:45:15,234 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort] starting
2014-08-22 22:45:15,235 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:45:15,235 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_false_false_true"]
2014-08-22 22:45:15,235 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  parallel execution is enabled: false
2014-08-22 22:45:15,235 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  starting jobs: 1
2014-08-22 22:45:15,235 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  allocating threads: 1
2014-08-22 22:45:15,236 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...ive/true_false_false_true
2014-08-22 22:45:15,237 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:45:15,238 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:45:15,262 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:45:15,281 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-08-22 22:45:15,296 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local778820610_0020
2014-08-22 22:45:15,311 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity778820610/.staging/job_local778820610_0020/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:45:15,312 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity778820610/.staging/job_local778820610_0020/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:45:15,354 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local778820610_0020/job_local778820610_0020.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:45:15,355 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local778820610_0020/job_local778820610_0020.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:45:15,355 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-08-22 22:45:15,356 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local778820610_0020
2014-08-22 22:45:15,356 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-08-22 22:45:15,356 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2014-08-22 22:45:15,356 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-08-22 22:45:15,359 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-08-22 22:45:15,359 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local778820610_0020_m_000000_0
2014-08-22 22:45:15,361 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:45:15,362 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt
2014-08-22 22:45:15,362 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@23d4616f
2014-08-22 22:45:15,363 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2014-08-22 22:45:15,363 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2014-08-22 22:45:15,387 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2014-08-22 22:45:15,388 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2014-08-22 22:45:15,388 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2014-08-22 22:45:15,388 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2014-08-22 22:45:15,388 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2014-08-22 22:45:15,390 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.5.6
2014-08-22 22:45:15,390 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2014-08-22 22:45:15,400 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:45:15,400 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:45:15,406 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2014-08-22 22:45:15,406 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2014-08-22 22:45:15,406 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2014-08-22 22:45:15,406 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 888; bufvoid = 104857600
2014-08-22 22:45:15,406 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2014-08-22 22:45:15,410 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2014-08-22 22:45:15,412 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local778820610_0020_m_000000_0 is done. And is in the process of committing
2014-08-22 22:45:15,415 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2014-08-22 22:45:15,415 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local778820610_0020_m_000000_0' done.
2014-08-22 22:45:15,415 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local778820610_0020_m_000000_0
2014-08-22 22:45:15,415 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-08-22 22:45:15,416 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2014-08-22 22:45:15,416 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local778820610_0020_r_000000_0
2014-08-22 22:45:15,418 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:45:15,418 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@5111778a
2014-08-22 22:45:15,419 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2014-08-22 22:45:15,421 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local778820610_0020_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2014-08-22 22:45:15,423 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#20 about to shuffle output of map attempt_local778820610_0020_m_000000_0 decomp: 964 len: 968 to MEMORY
2014-08-22 22:45:15,423 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 964 bytes from map-output for attempt_local778820610_0020_m_000000_0
2014-08-22 22:45:15,423 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 964, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->964
2014-08-22 22:45:15,424 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2014-08-22 22:45:15,425 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:15,425 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2014-08-22 22:45:15,431 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:45:15,431 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2014-08-22 22:45:15,433 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 964 bytes to disk to satisfy reduce memory limit
2014-08-22 22:45:15,434 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 968 bytes from disk
2014-08-22 22:45:15,434 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2014-08-22 22:45:15,434 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:45:15,435 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2014-08-22 22:45:15,436 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:15,437 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.5.6
2014-08-22 22:45:15,437 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2014-08-22 22:45:15,444 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:45:15,444 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_false_false_true"]
2014-08-22 22:45:15,458 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local778820610_0020_r_000000_0 is done. And is in the process of committing
2014-08-22 22:45:15,460 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:15,460 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local778820610_0020_r_000000_0 is allowed to commit now
2014-08-22 22:45:15,461 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local778820610_0020_r_000000_0' to file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_false_false_true/_temporary/0/task_local778820610_0020_r_000000
2014-08-22 22:45:15,462 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2014-08-22 22:45:15,462 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local778820610_0020_r_000000_0' done.
2014-08-22 22:45:15,462 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local778820610_0020_r_000000_0
2014-08-22 22:45:15,462 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2014-08-22 22:45:15,484 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_false_false_true/_temporary
2014-08-22 22:45:15,511 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:45:15,528 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2014-08-22 22:45:15,528 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.6/31997f144a2e73eebf04d45ed31402ee30118b2/cascading-hadoop2-mr1-2.5.6.jar
2014-08-22 22:45:15,535 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-08-22 22:45:15,537 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-22 22:45:15,538 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-08-22 22:45:15,543 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort] starting
2014-08-22 22:45:15,543 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:45:15,543 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_true_false_true"]
2014-08-22 22:45:15,543 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  parallel execution is enabled: false
2014-08-22 22:45:15,543 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  starting jobs: 1
2014-08-22 22:45:15,543 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  allocating threads: 1
2014-08-22 22:45:15,544 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...sive/true_true_false_true
2014-08-22 22:45:15,545 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:45:15,546 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:45:15,569 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:45:15,587 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-08-22 22:45:15,603 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1803954809_0021
2014-08-22 22:45:15,617 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity1803954809/.staging/job_local1803954809_0021/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:45:15,618 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity1803954809/.staging/job_local1803954809_0021/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:45:15,660 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1803954809_0021/job_local1803954809_0021.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:45:15,661 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1803954809_0021/job_local1803954809_0021.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:45:15,662 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-08-22 22:45:15,662 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local1803954809_0021
2014-08-22 22:45:15,662 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-08-22 22:45:15,663 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2014-08-22 22:45:15,663 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-08-22 22:45:15,666 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-08-22 22:45:15,666 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1803954809_0021_m_000000_0
2014-08-22 22:45:15,668 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:45:15,669 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt
2014-08-22 22:45:15,669 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@583f5cc3
2014-08-22 22:45:15,670 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2014-08-22 22:45:15,672 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2014-08-22 22:45:15,696 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2014-08-22 22:45:15,697 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2014-08-22 22:45:15,697 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2014-08-22 22:45:15,698 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2014-08-22 22:45:15,698 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2014-08-22 22:45:15,704 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.5.6
2014-08-22 22:45:15,704 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2014-08-22 22:45:15,712 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:45:15,713 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:45:15,718 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2014-08-22 22:45:15,719 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2014-08-22 22:45:15,719 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2014-08-22 22:45:15,719 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 888; bufvoid = 104857600
2014-08-22 22:45:15,720 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2014-08-22 22:45:15,724 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2014-08-22 22:45:15,726 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1803954809_0021_m_000000_0 is done. And is in the process of committing
2014-08-22 22:45:15,728 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2014-08-22 22:45:15,728 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1803954809_0021_m_000000_0' done.
2014-08-22 22:45:15,728 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1803954809_0021_m_000000_0
2014-08-22 22:45:15,729 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-08-22 22:45:15,729 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2014-08-22 22:45:15,729 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1803954809_0021_r_000000_0
2014-08-22 22:45:15,731 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:45:15,731 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@73486eef
2014-08-22 22:45:15,732 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2014-08-22 22:45:15,733 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1803954809_0021_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2014-08-22 22:45:15,734 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#21 about to shuffle output of map attempt_local1803954809_0021_m_000000_0 decomp: 964 len: 968 to MEMORY
2014-08-22 22:45:15,735 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 964 bytes from map-output for attempt_local1803954809_0021_m_000000_0
2014-08-22 22:45:15,735 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 964, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->964
2014-08-22 22:45:15,736 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2014-08-22 22:45:15,737 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:15,737 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2014-08-22 22:45:15,739 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:45:15,740 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2014-08-22 22:45:15,741 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 964 bytes to disk to satisfy reduce memory limit
2014-08-22 22:45:15,742 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 968 bytes from disk
2014-08-22 22:45:15,742 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2014-08-22 22:45:15,742 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:45:15,742 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2014-08-22 22:45:15,743 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:15,745 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.5.6
2014-08-22 22:45:15,745 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2014-08-22 22:45:15,753 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:45:15,753 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_true_false_true"]
2014-08-22 22:45:15,767 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1803954809_0021_r_000000_0 is done. And is in the process of committing
2014-08-22 22:45:15,768 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:15,768 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local1803954809_0021_r_000000_0 is allowed to commit now
2014-08-22 22:45:15,769 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1803954809_0021_r_000000_0' to file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_true_false_true/_temporary/0/task_local1803954809_0021_r_000000
2014-08-22 22:45:15,770 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2014-08-22 22:45:15,771 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1803954809_0021_r_000000_0' done.
2014-08-22 22:45:15,771 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1803954809_0021_r_000000_0
2014-08-22 22:45:15,771 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2014-08-22 22:45:15,786 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_true_false_true/_temporary
2014-08-22 22:45:15,812 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:45:15,830 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2014-08-22 22:45:15,830 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.6/31997f144a2e73eebf04d45ed31402ee30118b2/cascading-hadoop2-mr1-2.5.6.jar
2014-08-22 22:45:15,837 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-08-22 22:45:15,839 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-22 22:45:15,840 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-08-22 22:45:15,844 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort] starting
2014-08-22 22:45:15,844 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:45:15,844 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_true_false_true"]
2014-08-22 22:45:15,844 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  parallel execution is enabled: false
2014-08-22 22:45:15,845 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  starting jobs: 1
2014-08-22 22:45:15,845 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  allocating threads: 1
2014-08-22 22:45:15,845 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...ive/false_true_false_true
2014-08-22 22:45:15,846 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:45:15,847 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:45:15,870 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:45:15,889 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-08-22 22:45:15,904 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1695477730_0022
2014-08-22 22:45:15,918 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity1695477730/.staging/job_local1695477730_0022/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:45:15,920 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity1695477730/.staging/job_local1695477730_0022/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:45:15,960 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1695477730_0022/job_local1695477730_0022.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:45:15,962 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1695477730_0022/job_local1695477730_0022.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:45:15,962 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-08-22 22:45:15,963 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-08-22 22:45:15,963 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-08-22 22:45:15,963 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local1695477730_0022
2014-08-22 22:45:15,964 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2014-08-22 22:45:15,966 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-08-22 22:45:15,966 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1695477730_0022_m_000000_0
2014-08-22 22:45:15,967 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:45:15,968 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt
2014-08-22 22:45:15,969 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@6f2e5050
2014-08-22 22:45:15,970 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2014-08-22 22:45:15,970 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2014-08-22 22:45:15,993 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2014-08-22 22:45:15,993 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2014-08-22 22:45:15,993 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2014-08-22 22:45:15,993 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2014-08-22 22:45:15,993 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2014-08-22 22:45:15,995 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.5.6
2014-08-22 22:45:15,995 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2014-08-22 22:45:16,003 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:45:16,003 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:45:16,008 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2014-08-22 22:45:16,008 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2014-08-22 22:45:16,009 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2014-08-22 22:45:16,009 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 888; bufvoid = 104857600
2014-08-22 22:45:16,009 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2014-08-22 22:45:16,013 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2014-08-22 22:45:16,015 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1695477730_0022_m_000000_0 is done. And is in the process of committing
2014-08-22 22:45:16,017 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2014-08-22 22:45:16,017 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1695477730_0022_m_000000_0' done.
2014-08-22 22:45:16,017 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1695477730_0022_m_000000_0
2014-08-22 22:45:16,017 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-08-22 22:45:16,018 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2014-08-22 22:45:16,018 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1695477730_0022_r_000000_0
2014-08-22 22:45:16,019 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:45:16,020 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@4732a704
2014-08-22 22:45:16,020 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2014-08-22 22:45:16,021 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1695477730_0022_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2014-08-22 22:45:16,022 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#22 about to shuffle output of map attempt_local1695477730_0022_m_000000_0 decomp: 964 len: 968 to MEMORY
2014-08-22 22:45:16,083 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 964 bytes from map-output for attempt_local1695477730_0022_m_000000_0
2014-08-22 22:45:16,083 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 964, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->964
2014-08-22 22:45:16,084 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2014-08-22 22:45:16,085 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:16,086 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2014-08-22 22:45:16,088 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:45:16,088 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2014-08-22 22:45:16,090 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 964 bytes to disk to satisfy reduce memory limit
2014-08-22 22:45:16,090 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 968 bytes from disk
2014-08-22 22:45:16,091 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2014-08-22 22:45:16,091 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:45:16,091 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2014-08-22 22:45:16,092 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:16,092 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.5.6
2014-08-22 22:45:16,092 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2014-08-22 22:45:16,099 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:45:16,099 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_true_false_true"]
2014-08-22 22:45:16,112 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1695477730_0022_r_000000_0 is done. And is in the process of committing
2014-08-22 22:45:16,113 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:16,113 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local1695477730_0022_r_000000_0 is allowed to commit now
2014-08-22 22:45:16,114 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1695477730_0022_r_000000_0' to file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_true_false_true/_temporary/0/task_local1695477730_0022_r_000000
2014-08-22 22:45:16,115 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2014-08-22 22:45:16,115 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1695477730_0022_r_000000_0' done.
2014-08-22 22:45:16,116 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1695477730_0022_r_000000_0
2014-08-22 22:45:16,116 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2014-08-22 22:45:16,130 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_true_false_true/_temporary
2014-08-22 22:45:16,156 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:45:16,173 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2014-08-22 22:45:16,173 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.6/31997f144a2e73eebf04d45ed31402ee30118b2/cascading-hadoop2-mr1-2.5.6.jar
2014-08-22 22:45:16,179 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-08-22 22:45:16,181 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-22 22:45:16,181 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-08-22 22:45:16,185 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort] starting
2014-08-22 22:45:16,186 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:45:16,186 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_false_true_true"]
2014-08-22 22:45:16,186 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  parallel execution is enabled: false
2014-08-22 22:45:16,186 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  starting jobs: 1
2014-08-22 22:45:16,186 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  allocating threads: 1
2014-08-22 22:45:16,187 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...ive/false_false_true_true
2014-08-22 22:45:16,187 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:45:16,188 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:45:16,211 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:45:16,229 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-08-22 22:45:16,244 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local671360655_0023
2014-08-22 22:45:16,258 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity671360655/.staging/job_local671360655_0023/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:45:16,258 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity671360655/.staging/job_local671360655_0023/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:45:16,298 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local671360655_0023/job_local671360655_0023.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:45:16,299 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local671360655_0023/job_local671360655_0023.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:45:16,299 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-08-22 22:45:16,300 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local671360655_0023
2014-08-22 22:45:16,300 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-08-22 22:45:16,300 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2014-08-22 22:45:16,300 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-08-22 22:45:16,303 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-08-22 22:45:16,303 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local671360655_0023_m_000000_0
2014-08-22 22:45:16,304 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:45:16,306 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt
2014-08-22 22:45:16,306 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@78b4fa48
2014-08-22 22:45:16,307 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2014-08-22 22:45:16,307 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2014-08-22 22:45:16,330 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2014-08-22 22:45:16,330 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2014-08-22 22:45:16,331 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2014-08-22 22:45:16,331 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2014-08-22 22:45:16,331 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2014-08-22 22:45:16,332 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.5.6
2014-08-22 22:45:16,332 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2014-08-22 22:45:16,340 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:45:16,340 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:45:16,345 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2014-08-22 22:45:16,345 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2014-08-22 22:45:16,345 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2014-08-22 22:45:16,346 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 888; bufvoid = 104857600
2014-08-22 22:45:16,346 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2014-08-22 22:45:16,350 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2014-08-22 22:45:16,351 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local671360655_0023_m_000000_0 is done. And is in the process of committing
2014-08-22 22:45:16,353 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2014-08-22 22:45:16,353 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local671360655_0023_m_000000_0' done.
2014-08-22 22:45:16,354 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local671360655_0023_m_000000_0
2014-08-22 22:45:16,354 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-08-22 22:45:16,354 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2014-08-22 22:45:16,354 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local671360655_0023_r_000000_0
2014-08-22 22:45:16,356 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:45:16,356 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@364be9a8
2014-08-22 22:45:16,357 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2014-08-22 22:45:16,357 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local671360655_0023_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2014-08-22 22:45:16,359 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#23 about to shuffle output of map attempt_local671360655_0023_m_000000_0 decomp: 964 len: 968 to MEMORY
2014-08-22 22:45:16,360 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 964 bytes from map-output for attempt_local671360655_0023_m_000000_0
2014-08-22 22:45:16,360 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 964, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->964
2014-08-22 22:45:16,361 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2014-08-22 22:45:16,362 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:16,362 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2014-08-22 22:45:16,364 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:45:16,364 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2014-08-22 22:45:16,367 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 964 bytes to disk to satisfy reduce memory limit
2014-08-22 22:45:16,368 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 968 bytes from disk
2014-08-22 22:45:16,368 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2014-08-22 22:45:16,369 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:45:16,369 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2014-08-22 22:45:16,370 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:16,371 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.5.6
2014-08-22 22:45:16,371 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2014-08-22 22:45:16,378 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:45:16,378 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_false_true_true"]
2014-08-22 22:45:16,391 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local671360655_0023_r_000000_0 is done. And is in the process of committing
2014-08-22 22:45:16,393 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:16,393 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local671360655_0023_r_000000_0 is allowed to commit now
2014-08-22 22:45:16,394 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local671360655_0023_r_000000_0' to file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_false_true_true/_temporary/0/task_local671360655_0023_r_000000
2014-08-22 22:45:16,395 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2014-08-22 22:45:16,395 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local671360655_0023_r_000000_0' done.
2014-08-22 22:45:16,396 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local671360655_0023_r_000000_0
2014-08-22 22:45:16,396 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2014-08-22 22:45:16,417 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_false_true_true/_temporary
2014-08-22 22:45:16,444 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:45:16,461 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2014-08-22 22:45:16,461 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.6/31997f144a2e73eebf04d45ed31402ee30118b2/cascading-hadoop2-mr1-2.5.6.jar
2014-08-22 22:45:16,467 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-08-22 22:45:16,469 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-22 22:45:16,469 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-08-22 22:45:16,473 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort] starting
2014-08-22 22:45:16,474 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:45:16,474 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_false_true_true"]
2014-08-22 22:45:16,474 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  parallel execution is enabled: false
2014-08-22 22:45:16,474 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  starting jobs: 1
2014-08-22 22:45:16,474 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  allocating threads: 1
2014-08-22 22:45:16,475 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...sive/true_false_true_true
2014-08-22 22:45:16,476 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:45:16,476 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:45:16,500 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:45:16,518 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-08-22 22:45:16,533 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local571277785_0024
2014-08-22 22:45:16,549 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity571277785/.staging/job_local571277785_0024/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:45:16,550 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity571277785/.staging/job_local571277785_0024/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:45:16,591 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local571277785_0024/job_local571277785_0024.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:45:16,592 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local571277785_0024/job_local571277785_0024.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:45:16,593 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-08-22 22:45:16,593 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local571277785_0024
2014-08-22 22:45:16,593 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-08-22 22:45:16,593 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2014-08-22 22:45:16,593 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-08-22 22:45:16,596 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-08-22 22:45:16,596 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local571277785_0024_m_000000_0
2014-08-22 22:45:16,598 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:45:16,599 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt
2014-08-22 22:45:16,599 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@1a7c9625
2014-08-22 22:45:16,600 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2014-08-22 22:45:16,601 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2014-08-22 22:45:16,624 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2014-08-22 22:45:16,624 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2014-08-22 22:45:16,624 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2014-08-22 22:45:16,624 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2014-08-22 22:45:16,625 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2014-08-22 22:45:16,626 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.5.6
2014-08-22 22:45:16,626 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2014-08-22 22:45:16,633 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:45:16,634 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:45:16,639 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2014-08-22 22:45:16,639 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2014-08-22 22:45:16,639 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2014-08-22 22:45:16,639 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 888; bufvoid = 104857600
2014-08-22 22:45:16,639 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2014-08-22 22:45:16,644 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2014-08-22 22:45:16,645 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local571277785_0024_m_000000_0 is done. And is in the process of committing
2014-08-22 22:45:16,647 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2014-08-22 22:45:16,647 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local571277785_0024_m_000000_0' done.
2014-08-22 22:45:16,647 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local571277785_0024_m_000000_0
2014-08-22 22:45:16,647 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-08-22 22:45:16,648 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2014-08-22 22:45:16,648 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local571277785_0024_r_000000_0
2014-08-22 22:45:16,650 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:45:16,650 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@2330a31
2014-08-22 22:45:16,650 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2014-08-22 22:45:16,651 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local571277785_0024_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2014-08-22 22:45:16,653 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#24 about to shuffle output of map attempt_local571277785_0024_m_000000_0 decomp: 964 len: 968 to MEMORY
2014-08-22 22:45:16,653 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 964 bytes from map-output for attempt_local571277785_0024_m_000000_0
2014-08-22 22:45:16,653 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 964, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->964
2014-08-22 22:45:16,654 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2014-08-22 22:45:16,655 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:16,655 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2014-08-22 22:45:16,657 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:45:16,658 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2014-08-22 22:45:16,659 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 964 bytes to disk to satisfy reduce memory limit
2014-08-22 22:45:16,660 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 968 bytes from disk
2014-08-22 22:45:16,660 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2014-08-22 22:45:16,660 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:45:16,660 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2014-08-22 22:45:16,661 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:16,662 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.5.6
2014-08-22 22:45:16,662 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2014-08-22 22:45:16,668 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:45:16,668 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_false_true_true"]
2014-08-22 22:45:16,681 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local571277785_0024_r_000000_0 is done. And is in the process of committing
2014-08-22 22:45:16,682 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:16,683 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local571277785_0024_r_000000_0 is allowed to commit now
2014-08-22 22:45:16,683 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local571277785_0024_r_000000_0' to file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_false_true_true/_temporary/0/task_local571277785_0024_r_000000
2014-08-22 22:45:16,685 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2014-08-22 22:45:16,685 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local571277785_0024_r_000000_0' done.
2014-08-22 22:45:16,685 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local571277785_0024_r_000000_0
2014-08-22 22:45:16,685 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2014-08-22 22:45:16,700 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_false_true_true/_temporary
2014-08-22 22:45:16,727 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:45:16,744 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2014-08-22 22:45:16,745 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.6/31997f144a2e73eebf04d45ed31402ee30118b2/cascading-hadoop2-mr1-2.5.6.jar
2014-08-22 22:45:16,750 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-08-22 22:45:16,752 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-22 22:45:16,752 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-08-22 22:45:16,756 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort] starting
2014-08-22 22:45:16,757 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:45:16,757 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_true_true_true"]
2014-08-22 22:45:16,757 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  parallel execution is enabled: false
2014-08-22 22:45:16,757 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  starting jobs: 1
2014-08-22 22:45:16,757 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  allocating threads: 1
2014-08-22 22:45:16,758 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...nsive/true_true_true_true
2014-08-22 22:45:16,759 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:45:16,759 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:45:16,783 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:45:16,800 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-08-22 22:45:16,814 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local505261484_0025
2014-08-22 22:45:16,828 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity505261484/.staging/job_local505261484_0025/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:45:16,829 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity505261484/.staging/job_local505261484_0025/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:45:16,867 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local505261484_0025/job_local505261484_0025.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:45:16,869 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local505261484_0025/job_local505261484_0025.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:45:16,869 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-08-22 22:45:16,869 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local505261484_0025
2014-08-22 22:45:16,870 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2014-08-22 22:45:16,870 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-08-22 22:45:16,870 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-08-22 22:45:16,873 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-08-22 22:45:16,873 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local505261484_0025_m_000000_0
2014-08-22 22:45:16,874 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:45:16,876 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt
2014-08-22 22:45:16,876 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@375062c7
2014-08-22 22:45:16,877 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2014-08-22 22:45:16,877 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2014-08-22 22:45:16,900 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2014-08-22 22:45:16,900 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2014-08-22 22:45:16,900 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2014-08-22 22:45:16,901 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2014-08-22 22:45:16,901 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2014-08-22 22:45:16,903 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.5.6
2014-08-22 22:45:16,903 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2014-08-22 22:45:16,911 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:45:16,912 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:45:16,917 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2014-08-22 22:45:16,917 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2014-08-22 22:45:16,917 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2014-08-22 22:45:16,918 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 888; bufvoid = 104857600
2014-08-22 22:45:16,918 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2014-08-22 22:45:16,921 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2014-08-22 22:45:16,923 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local505261484_0025_m_000000_0 is done. And is in the process of committing
2014-08-22 22:45:16,925 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2014-08-22 22:45:16,925 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local505261484_0025_m_000000_0' done.
2014-08-22 22:45:16,925 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local505261484_0025_m_000000_0
2014-08-22 22:45:16,925 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-08-22 22:45:16,926 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2014-08-22 22:45:16,926 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local505261484_0025_r_000000_0
2014-08-22 22:45:16,927 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:45:16,927 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@592ed60d
2014-08-22 22:45:16,928 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2014-08-22 22:45:16,929 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local505261484_0025_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2014-08-22 22:45:16,930 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#25 about to shuffle output of map attempt_local505261484_0025_m_000000_0 decomp: 964 len: 968 to MEMORY
2014-08-22 22:45:16,931 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 964 bytes from map-output for attempt_local505261484_0025_m_000000_0
2014-08-22 22:45:16,931 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 964, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->964
2014-08-22 22:45:16,932 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2014-08-22 22:45:16,933 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:16,933 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2014-08-22 22:45:16,938 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:45:16,938 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2014-08-22 22:45:16,940 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 964 bytes to disk to satisfy reduce memory limit
2014-08-22 22:45:16,940 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 968 bytes from disk
2014-08-22 22:45:16,940 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2014-08-22 22:45:16,941 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:45:16,941 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2014-08-22 22:45:16,942 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:16,943 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.5.6
2014-08-22 22:45:16,943 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2014-08-22 22:45:16,949 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:45:16,950 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_true_true_true"]
2014-08-22 22:45:16,963 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local505261484_0025_r_000000_0 is done. And is in the process of committing
2014-08-22 22:45:16,964 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:16,964 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local505261484_0025_r_000000_0 is allowed to commit now
2014-08-22 22:45:16,965 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local505261484_0025_r_000000_0' to file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_true_true_true/_temporary/0/task_local505261484_0025_r_000000
2014-08-22 22:45:16,966 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2014-08-22 22:45:16,966 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local505261484_0025_r_000000_0' done.
2014-08-22 22:45:16,966 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local505261484_0025_r_000000_0
2014-08-22 22:45:16,967 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2014-08-22 22:45:16,987 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_true_true_true/_temporary
2014-08-22 22:45:17,013 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:45:17,030 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2014-08-22 22:45:17,031 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.6/31997f144a2e73eebf04d45ed31402ee30118b2/cascading-hadoop2-mr1-2.5.6.jar
2014-08-22 22:45:17,036 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-08-22 22:45:17,038 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-22 22:45:17,039 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-08-22 22:45:17,043 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort] starting
2014-08-22 22:45:17,043 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:45:17,044 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_true_true_true"]
2014-08-22 22:45:17,044 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  parallel execution is enabled: false
2014-08-22 22:45:17,044 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  starting jobs: 1
2014-08-22 22:45:17,044 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [comprehensivesort]  allocating threads: 1
2014-08-22 22:45:17,044 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...sive/false_true_true_true
2014-08-22 22:45:17,045 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:45:17,046 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 22:45:17,069 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:45:17,086 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-08-22 22:45:17,100 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local730977655_0026
2014-08-22 22:45:17,115 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity730977655/.staging/job_local730977655_0026/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:45:17,116 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/staging/teamcity730977655/.staging/job_local730977655_0026/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:45:17,158 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local730977655_0026/job_local730977655_0026.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-08-22 22:45:17,159 WARN  conf.Configuration (Configuration.java:loadProperty(2358)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local730977655_0026/job_local730977655_0026.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-08-22 22:45:17,160 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-08-22 22:45:17,160 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local730977655_0026
2014-08-22 22:45:17,160 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-08-22 22:45:17,160 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2014-08-22 22:45:17,161 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-08-22 22:45:17,163 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-08-22 22:45:17,163 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local730977655_0026_m_000000_0
2014-08-22 22:45:17,165 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:45:17,166 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt
2014-08-22 22:45:17,167 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@229ec9cd
2014-08-22 22:45:17,168 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2014-08-22 22:45:17,168 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2014-08-22 22:45:17,191 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2014-08-22 22:45:17,192 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2014-08-22 22:45:17,192 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2014-08-22 22:45:17,192 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2014-08-22 22:45:17,192 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2014-08-22 22:45:17,194 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.5.6
2014-08-22 22:45:17,195 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2014-08-22 22:45:17,202 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt"]
2014-08-22 22:45:17,202 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:45:17,208 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2014-08-22 22:45:17,208 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2014-08-22 22:45:17,208 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2014-08-22 22:45:17,209 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 888; bufvoid = 104857600
2014-08-22 22:45:17,209 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2014-08-22 22:45:17,213 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2014-08-22 22:45:17,215 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local730977655_0026_m_000000_0 is done. And is in the process of committing
2014-08-22 22:45:17,217 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2014-08-22 22:45:17,217 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local730977655_0026_m_000000_0' done.
2014-08-22 22:45:17,217 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local730977655_0026_m_000000_0
2014-08-22 22:45:17,218 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-08-22 22:45:17,218 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2014-08-22 22:45:17,218 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local730977655_0026_r_000000_0
2014-08-22 22:45:17,220 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-08-22 22:45:17,220 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@7e2696d2
2014-08-22 22:45:17,221 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2014-08-22 22:45:17,222 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local730977655_0026_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2014-08-22 22:45:17,223 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#26 about to shuffle output of map attempt_local730977655_0026_m_000000_0 decomp: 964 len: 968 to MEMORY
2014-08-22 22:45:17,224 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 964 bytes from map-output for attempt_local730977655_0026_m_000000_0
2014-08-22 22:45:17,224 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 964, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->964
2014-08-22 22:45:17,225 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2014-08-22 22:45:17,226 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:17,226 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2014-08-22 22:45:17,229 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:45:17,229 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2014-08-22 22:45:17,231 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 964 bytes to disk to satisfy reduce memory limit
2014-08-22 22:45:17,231 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 968 bytes from disk
2014-08-22 22:45:17,232 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2014-08-22 22:45:17,232 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-08-22 22:45:17,232 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2014-08-22 22:45:17,233 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:17,234 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.5.6
2014-08-22 22:45:17,234 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2014-08-22 22:45:17,240 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2014-08-22 22:45:17,241 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_true_true_true"]
2014-08-22 22:45:17,254 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local730977655_0026_r_000000_0 is done. And is in the process of committing
2014-08-22 22:45:17,255 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-08-22 22:45:17,255 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local730977655_0026_r_000000_0 is allowed to commit now
2014-08-22 22:45:17,256 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local730977655_0026_r_000000_0' to file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_true_true_true/_temporary/0/task_local730977655_0026_r_000000
2014-08-22 22:45:17,257 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2014-08-22 22:45:17,257 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local730977655_0026_r_000000_0' done.
2014-08-22 22:45:17,258 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local730977655_0026_r_000000_0
2014-08-22 22:45:17,258 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2014-08-22 22:45:17,279 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_true_true_true/_temporary
2014-08-22 22:45:17,306 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2014-08-22 22:45:17,309 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/true_false_false_true
2014-08-22 22:45:17,309 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/true_null_false_true
2014-08-22 22:45:17,309 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/true_true_false_false
2014-08-22 22:45:17,310 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/true_null_true_true
2014-08-22 22:45:17,310 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/false_null_true_true
2014-08-22 22:45:17,310 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/true_null_false_false
2014-08-22 22:45:17,310 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/true_false_false_false
2014-08-22 22:45:17,310 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/false_true_true_true
2014-08-22 22:45:17,311 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/false_null_true_false
2014-08-22 22:45:17,311 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/false_true_false_true
2014-08-22 22:45:17,311 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/false_false_false_false
2014-08-22 22:45:17,311 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/false_true_false_false
2014-08-22 22:45:17,311 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/true_false_true_false
2014-08-22 22:45:17,312 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/true_true_true_true
2014-08-22 22:45:17,312 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/false_false_true_true
2014-08-22 22:45:17,312 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/false_null_false_false
2014-08-22 22:45:17,312 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/false_true_true_false
2014-08-22 22:45:17,312 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/false_null_false_true
2014-08-22 22:45:17,313 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/false_false_false_true
2014-08-22 22:45:17,313 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/true_null_true_false
2014-08-22 22:45:17,313 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/true_false_true_true
2014-08-22 22:45:17,313 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/false_false_true_false
2014-08-22 22:45:17,314 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/true_true_true_false
2014-08-22 22:45:17,314 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.4.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/true_true_false_true