2015-02-11 00:07:11,184 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(187)) - found 1 test platforms from classpath
2015-02-11 00:07:11,248 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(237)) - installing platform: hadoop2-mr1
2015-02-11 00:07:11,248 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(238)) - running test: cascading.SortedValuesPlatformTest
2015-02-11 00:07:11,291 INFO hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(105)) - not using cluster
2015-02-11 00:07:11,950 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2015-02-11 00:07:12,299 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:07:12,303 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:07:12,316 INFO property.AppProps (AppProps.java:getAppID(169)) - using app.id: 83D3422E36104FDF97C951A2303E9FF1
2015-02-11 00:07:12,427 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:07:12,471 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:07:12,475 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:07:12,616 INFO util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 2.6.3
2015-02-11 00:07:12,620 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [apache*ip] starting
2015-02-11 00:07:12,621 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [apache*ip] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/apache.200.txt"]
2015-02-11 00:07:12,621 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [apache*ip] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/ips.20.txt"]
2015-02-11 00:07:12,622 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [apache*ip] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/cogroupcomparereversed"]
2015-02-11 00:07:12,624 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [apache*ip] parallel execution is enabled: false
2015-02-11 00:07:12,625 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [apache*ip] starting jobs: 1
2015-02-11 00:07:12,625 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [apache*ip] allocating threads: 1
2015-02-11 00:07:12,628 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [apache*ip] starting step: (1/1) ...rm/cogroupcomparereversed
2015-02-11 00:07:12,654 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - session.id is deprecated. Instead, use dfs.metrics.session-id
2015-02-11 00:07:12,656 INFO jvm.JvmMetrics (JvmMetrics.java:init(76)) - Initializing JVM Metrics with processName=JobTracker, sessionId=
2015-02-11 00:07:12,684 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:07:13,092 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:07:13,105 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:07:13,141 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:2
2015-02-11 00:07:13,319 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local205968684_0001
2015-02-11 00:07:13,359 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity205968684/.staging/job_local205968684_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:07:13,366 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity205968684/.staging/job_local205968684_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:07:13,500 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local205968684_0001/job_local205968684_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:07:13,504 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local205968684_0001/job_local205968684_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:07:13,510 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:07:13,512 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:07:13,515 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [apache*ip] submitted hadoop job: job_local205968684_0001
2015-02-11 00:07:13,515 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [apache*ip] tracking url: http://localhost:8080/
2015-02-11 00:07:13,516 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:07:13,559 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:07:13,562 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local205968684_0001_m_000000_0
2015-02-11 00:07:13,606 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:07:13,619 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/apache.200.txt
2015-02-11 00:07:13,620 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@5c71949b
2015-02-11 00:07:13,630 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:07:13,638 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:07:13,794 INFO mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:07:13,795 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:07:13,795 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:07:13,795 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:07:13,795 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:07:13,823 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:07:13,823 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:07:13,887 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.task.partition is deprecated. Instead, use mapreduce.task.partition
2015-02-11 00:07:13,914 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/apache.200.txt"]
2015-02-11 00:07:13,915 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: CoGroup(apache*ip)[by: apache:[{1}:'octet'] ip:[{1}:'rawoctet']]
2015-02-11 00:07:13,996 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-11 00:07:13,996 INFO mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:07:13,997 INFO mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:07:13,997 INFO mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 9461; bufvoid = 104857600
2015-02-11 00:07:13,997 INFO mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26213600(104854400); length = 797/6553600
2015-02-11 00:07:19,600 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/apache.200.txt:0+32599 > sort
2015-02-11 00:07:25,602 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/apache.200.txt:0+32599 > sort
2015-02-11 00:07:28,604 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/apache.200.txt:0+32599 > sort
2015-02-11 00:07:31,605 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/apache.200.txt:0+32599 > sort
2015-02-11 00:07:34,607 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/apache.200.txt:0+32599 > sort
2015-02-11 00:07:37,270 INFO mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:07:37,274 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local205968684_0001_m_000000_0 is done. And is in the process of committing
2015-02-11 00:07:37,277 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/apache.200.txt:0+32599
2015-02-11 00:07:37,277 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local205968684_0001_m_000000_0' done.
2015-02-11 00:07:37,277 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local205968684_0001_m_000000_0
2015-02-11 00:07:37,277 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local205968684_0001_m_000001_0
2015-02-11 00:07:37,280 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:07:37,282 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/ips.20.txt
2015-02-11 00:07:37,282 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@307a140f
2015-02-11 00:07:37,284 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:07:37,284 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:07:37,435 INFO mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:07:37,435 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:07:37,435 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:07:37,435 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:07:37,436 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:07:37,439 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:07:37,439 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:07:37,459 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/ips.20.txt"]
2015-02-11 00:07:37,459 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: CoGroup(apache*ip)[by: apache:[{1}:'octet'] ip:[{1}:'rawoctet']]
2015-02-11 00:07:37,465 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-11 00:07:37,465 INFO mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:07:37,466 INFO mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:07:37,466 INFO mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 142; bufvoid = 104857600
2015-02-11 00:07:37,466 INFO mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:07:39,238 INFO mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:07:39,241 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local205968684_0001_m_000001_0 is done. And is in the process of committing
2015-02-11 00:07:39,244 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/ips.20.txt:0+275
2015-02-11 00:07:39,244 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local205968684_0001_m_000001_0' done.
2015-02-11 00:07:39,244 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local205968684_0001_m_000001_0
2015-02-11 00:07:39,245 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:07:39,247 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:07:39,248 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local205968684_0001_r_000000_0
2015-02-11 00:07:39,256 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:07:39,260 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@c481958
2015-02-11 00:07:39,276 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:07:39,280 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local205968684_0001_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:07:39,305 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#1 about to shuffle output of map attempt_local205968684_0001_m_000001_0 decomp: 184 len: 188 to MEMORY
2015-02-11 00:07:39,310 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 184 bytes from map-output for attempt_local205968684_0001_m_000001_0
2015-02-11 00:07:39,351 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 184, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->184
2015-02-11 00:07:39,356 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#1 about to shuffle output of map attempt_local205968684_0001_m_000000_0 decomp: 9863 len: 9867 to MEMORY
2015-02-11 00:07:39,356 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 9863 bytes from map-output for attempt_local205968684_0001_m_000000_0
2015-02-11 00:07:39,357 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 9863, inMemoryMapOutputs.size() -> 2, commitMemory -> 184, usedMemory ->10047
2015-02-11 00:07:39,357 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:07:39,359 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 2 / 2 copied.
2015-02-11 00:07:39,359 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 2 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:07:39,370 INFO mapred.Merger (Merger.java:merge(591)) - Merging 2 sorted segments
2015-02-11 00:07:39,394 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 2 segments left of total size: 10033 bytes
2015-02-11 00:07:44,475 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 2 segments, 10047 bytes to disk to satisfy reduce memory limit
2015-02-11 00:07:44,476 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 10049 bytes from disk
2015-02-11 00:07:44,477 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:07:44,477 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:07:44,478 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 10038 bytes
2015-02-11 00:07:44,479 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 2 / 2 copied.
2015-02-11 00:07:44,481 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:07:44,482 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:07:44,501 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: CoGroup(apache*ip)[by: apache:[{1}:'octet'] ip:[{1}:'rawoctet']]
2015-02-11 00:07:44,502 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/cogroupcomparereversed"]
2015-02-11 00:07:44,526 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-02-11 00:07:44,526 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2015-02-11 00:07:44,579 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local205968684_0001_r_000000_0 is done. And is in the process of committing
2015-02-11 00:07:44,581 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 2 / 2 copied.
2015-02-11 00:07:44,581 INFO mapred.Task (Task.java:commit(1162)) - Task attempt_local205968684_0001_r_000000_0 is allowed to commit now
2015-02-11 00:07:44,582 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local205968684_0001_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/cogroupcomparereversed/_temporary/0/task_local205968684_0001_r_000000
2015-02-11 00:07:44,584 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:07:44,584 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local205968684_0001_r_000000_0' done.
2015-02-11 00:07:44,585 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local205968684_0001_r_000000_0
2015-02-11 00:07:44,585 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:07:44,630 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/cogroupcomparereversed/_temporary
2015-02-11 00:07:44,666 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:07:44,707 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/cogroupcomparereversed
2015-02-11 00:07:44,743 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:07:44,744 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:07:44,772 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:07:44,782 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:07:44,783 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:07:44,801 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [apache*ip] starting
2015-02-11 00:07:44,801 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [apache*ip] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/apache.200.txt"]
2015-02-11 00:07:44,802 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [apache*ip] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/ips.20.txt"]
2015-02-11 00:07:44,802 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [apache*ip] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/cogroupcompareforward"]
2015-02-11 00:07:44,802 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [apache*ip] parallel execution is enabled: false
2015-02-11 00:07:44,803 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [apache*ip] starting jobs: 1
2015-02-11 00:07:44,803 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [apache*ip] allocating threads: 1
2015-02-11 00:07:44,803 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [apache*ip] starting step: (1/1) ...orm/cogroupcompareforward
2015-02-11 00:07:44,804 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:07:44,807 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:07:44,842 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:07:44,843 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:07:44,868 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:2
2015-02-11 00:07:44,901 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local677247746_0002
2015-02-11 00:07:44,919 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity677247746/.staging/job_local677247746_0002/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:07:44,922 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity677247746/.staging/job_local677247746_0002/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:07:44,989 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local677247746_0002/job_local677247746_0002.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:07:44,992 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local677247746_0002/job_local677247746_0002.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:07:44,993 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:07:44,993 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [apache*ip] submitted hadoop job: job_local677247746_0002
2015-02-11 00:07:44,993 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [apache*ip] tracking url: http://localhost:8080/
2015-02-11 00:07:44,994 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:07:44,994 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:07:44,999 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:07:45,000 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local677247746_0002_m_000000_0
2015-02-11 00:07:45,002 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:07:45,005 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/apache.200.txt
2015-02-11 00:07:45,005 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@c723704
2015-02-11 00:07:45,007 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:07:45,008 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:07:45,156 INFO mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:07:45,157 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:07:45,158 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:07:45,158 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:07:45,159 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:07:45,161 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:07:45,162 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:07:45,181 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/apache.200.txt"]
2015-02-11 00:07:45,182 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: CoGroup(apache*ip)[by: apache:[{1}:'octet'] ip:[{1}:'rawoctet']]
2015-02-11 00:07:45,231 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-11 00:07:45,231 INFO mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:07:45,232 INFO mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:07:45,232 INFO mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 9461; bufvoid = 104857600
2015-02-11 00:07:45,233 INFO mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26213600(104854400); length = 797/6553600
2015-02-11 00:07:51,006 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/apache.200.txt:0+32599 > sort
2015-02-11 00:07:54,008 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/apache.200.txt:0+32599 > sort
2015-02-11 00:07:57,010 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/apache.200.txt:0+32599 > sort
2015-02-11 00:08:00,011 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/apache.200.txt:0+32599 > sort
2015-02-11 00:08:03,013 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/apache.200.txt:0+32599 > sort
2015-02-11 00:08:04,811 INFO mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:08:04,815 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local677247746_0002_m_000000_0 is done. And is in the process of committing
2015-02-11 00:08:04,818 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/apache.200.txt:0+32599
2015-02-11 00:08:04,818 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local677247746_0002_m_000000_0' done.
2015-02-11 00:08:04,819 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local677247746_0002_m_000000_0
2015-02-11 00:08:04,819 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local677247746_0002_m_000001_0
2015-02-11 00:08:04,822 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:04,825 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/ips.20.txt
2015-02-11 00:08:04,826 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@28f553e3
2015-02-11 00:08:04,830 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:08:04,830 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:08:04,848 INFO mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:08:04,849 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:08:04,849 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:08:04,850 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:08:04,850 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:08:04,853 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:08:04,853 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:08:04,869 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/ips.20.txt"]
2015-02-11 00:08:04,870 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: CoGroup(apache*ip)[by: apache:[{1}:'octet'] ip:[{1}:'rawoctet']]
2015-02-11 00:08:04,875 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-11 00:08:04,876 INFO mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:08:04,876 INFO mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:08:04,877 INFO mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 142; bufvoid = 104857600
2015-02-11 00:08:04,877 INFO mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:08:06,964 INFO mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:08:06,968 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local677247746_0002_m_000001_0 is done. And is in the process of committing
2015-02-11 00:08:06,971 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/ips.20.txt:0+275
2015-02-11 00:08:06,971 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local677247746_0002_m_000001_0' done.
2015-02-11 00:08:06,972 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local677247746_0002_m_000001_0
2015-02-11 00:08:06,972 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:08:06,973 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:08:06,973 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local677247746_0002_r_000000_0
2015-02-11 00:08:06,976 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:06,976 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@3429dbb8
2015-02-11 00:08:06,978 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:08:06,979 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local677247746_0002_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:08:06,981 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#2 about to shuffle output of map attempt_local677247746_0002_m_000001_0 decomp: 184 len: 188 to MEMORY
2015-02-11 00:08:06,982 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 184 bytes from map-output for attempt_local677247746_0002_m_000001_0
2015-02-11 00:08:06,982 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 184, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->184
2015-02-11 00:08:06,985 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#2 about to shuffle output of map attempt_local677247746_0002_m_000000_0 decomp: 9863 len: 9867 to MEMORY
2015-02-11 00:08:06,986 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 9863 bytes from map-output for attempt_local677247746_0002_m_000000_0
2015-02-11 00:08:06,986 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 9863, inMemoryMapOutputs.size() -> 2, commitMemory -> 184, usedMemory ->10047
2015-02-11 00:08:06,986 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:08:06,988 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 2 / 2 copied.
2015-02-11 00:08:06,988 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 2 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:08:06,991 INFO mapred.Merger (Merger.java:merge(591)) - Merging 2 sorted segments
2015-02-11 00:08:07,014 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 2 segments left of total size: 10035 bytes
2015-02-11 00:08:11,675 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 2 segments, 10047 bytes to disk to satisfy reduce memory limit
2015-02-11 00:08:11,675 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 10049 bytes from disk
2015-02-11 00:08:11,676 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:08:11,676 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:11,676 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 10039 bytes
2015-02-11 00:08:11,677 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 2 / 2 copied.
2015-02-11 00:08:11,678 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:08:11,678 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:08:11,692 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: CoGroup(apache*ip)[by: apache:[{1}:'octet'] ip:[{1}:'rawoctet']]
2015-02-11 00:08:11,692 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/cogroupcompareforward"]
2015-02-11 00:08:11,705 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-02-11 00:08:11,705 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2015-02-11 00:08:11,745 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local677247746_0002_r_000000_0 is done. And is in the process of committing
2015-02-11 00:08:11,747 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 2 / 2 copied.
2015-02-11 00:08:11,747 INFO mapred.Task (Task.java:commit(1162)) - Task attempt_local677247746_0002_r_000000_0 is allowed to commit now
2015-02-11 00:08:11,748 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local677247746_0002_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/cogroupcompareforward/_temporary/0/task_local677247746_0002_r_000000
2015-02-11 00:08:11,750 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:08:11,750 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local677247746_0002_r_000000_0' done.
2015-02-11 00:08:11,750 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local677247746_0002_r_000000_0
2015-02-11 00:08:11,751 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:08:11,786 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/cogroupcompareforward/_temporary
2015-02-11 00:08:11,818 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:11,840 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/cogroupcompareforward
2015-02-11 00:08:11,867 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:08:11,867 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:08:11,906 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:08:11,906 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:08:11,921 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:08:11,926 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:08:11,927 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:08:11,940 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting
2015-02-11 00:08:11,940 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:11,941 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_null_false_false"]
2015-02-11 00:08:11,941 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] parallel execution is enabled: false
2015-02-11 00:08:11,941 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting jobs: 1
2015-02-11 00:08:11,941 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] allocating threads: 1
2015-02-11 00:08:11,942 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...ve/false_null_false_false
2015-02-11 00:08:11,945 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:11,946 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:11,979 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:12,005 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:08:12,068 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1839041560_0003
2015-02-11 00:08:12,084 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1839041560/.staging/job_local1839041560_0003/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:12,085 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1839041560/.staging/job_local1839041560_0003/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:12,136 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1839041560_0003/job_local1839041560_0003.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:12,137 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1839041560_0003/job_local1839041560_0003.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:12,138 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:08:12,138 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local1839041560_0003
2015-02-11 00:08:12,138 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-02-11 00:08:12,138 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:08:12,139 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:08:12,143 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:08:12,143 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1839041560_0003_m_000000_0
2015-02-11 00:08:12,146 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:12,147 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt
2015-02-11 00:08:12,148 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@51274873
2015-02-11 00:08:12,149 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:08:12,149 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:08:12,174 INFO mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:08:12,178 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:08:12,178 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:08:12,178 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:08:12,179 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:08:12,184 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:08:12,184 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:08:12,199 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:12,200 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:12,207 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-11 00:08:12,207 INFO mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:08:12,207 INFO mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:08:12,208 INFO mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 629; bufvoid = 104857600
2015-02-11 00:08:12,208 INFO mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2015-02-11 00:08:12,214 INFO mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:08:12,220 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local1839041560_0003_m_000000_0 is done. And is in the process of committing
2015-02-11 00:08:12,222 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2015-02-11 00:08:12,222 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1839041560_0003_m_000000_0' done.
2015-02-11 00:08:12,223 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1839041560_0003_m_000000_0
2015-02-11 00:08:12,223 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:08:12,224 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:08:12,224 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1839041560_0003_r_000000_0
2015-02-11 00:08:12,226 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:12,227 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@5f2471dc
2015-02-11 00:08:12,229 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:08:12,230 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1839041560_0003_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:08:12,232 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#3 about to shuffle output of map attempt_local1839041560_0003_m_000000_0 decomp: 705 len: 709 to MEMORY
2015-02-11 00:08:12,233 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 705 bytes from map-output for attempt_local1839041560_0003_m_000000_0
2015-02-11 00:08:12,233 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 705, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->705
2015-02-11 00:08:12,234 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:08:12,236 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:12,236 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:08:12,239 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:12,239 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 700 bytes
2015-02-11 00:08:12,242 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 705 bytes to disk to satisfy reduce memory limit
2015-02-11 00:08:12,243 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 709 bytes from disk
2015-02-11 00:08:12,243 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:08:12,243 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:12,243 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 700 bytes
2015-02-11 00:08:12,244 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:12,245 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:08:12,246 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:08:12,256 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:12,257 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_null_false_false"]
2015-02-11 00:08:12,277 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local1839041560_0003_r_000000_0 is done. And is in the process of committing
2015-02-11 00:08:12,279 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:12,280 INFO mapred.Task (Task.java:commit(1162)) - Task attempt_local1839041560_0003_r_000000_0 is allowed to commit now
2015-02-11 00:08:12,281 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1839041560_0003_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_null_false_false/_temporary/0/task_local1839041560_0003_r_000000
2015-02-11 00:08:12,283 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:08:12,283 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1839041560_0003_r_000000_0' done.
2015-02-11 00:08:12,283 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1839041560_0003_r_000000_0
2015-02-11 00:08:12,286 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:08:12,320 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_null_false_false/_temporary
2015-02-11 00:08:12,354 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:12,382 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:08:12,383 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:08:12,398 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:08:12,402 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:08:12,403 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:08:12,413 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting
2015-02-11 00:08:12,414 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:12,414 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_null_false_false"]
2015-02-11 00:08:12,414 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] parallel execution is enabled: false
2015-02-11 00:08:12,414 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting jobs: 1
2015-02-11 00:08:12,414 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] allocating threads: 1
2015-02-11 00:08:12,415 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...ive/true_null_false_false
2015-02-11 00:08:12,417 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:12,418 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:12,454 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:12,480 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:08:12,505 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1051448481_0004
2015-02-11 00:08:12,521 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1051448481/.staging/job_local1051448481_0004/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:12,522 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1051448481/.staging/job_local1051448481_0004/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:12,572 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1051448481_0004/job_local1051448481_0004.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:12,573 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1051448481_0004/job_local1051448481_0004.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:12,574 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:08:12,574 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local1051448481_0004
2015-02-11 00:08:12,575 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-02-11 00:08:12,575 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:08:12,575 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:08:12,579 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:08:12,580 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1051448481_0004_m_000000_0
2015-02-11 00:08:12,583 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:12,585 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt
2015-02-11 00:08:12,585 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@520b4c69
2015-02-11 00:08:12,587 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:08:12,588 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:08:12,864 INFO mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:08:12,867 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:08:12,868 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:08:12,869 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:08:12,869 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:08:12,871 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:08:12,871 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:08:12,881 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:12,881 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:12,889 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-11 00:08:12,889 INFO mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:08:12,890 INFO mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:08:12,890 INFO mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 629; bufvoid = 104857600
2015-02-11 00:08:12,890 INFO mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2015-02-11 00:08:15,439 INFO mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:08:15,443 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local1051448481_0004_m_000000_0 is done. And is in the process of committing
2015-02-11 00:08:15,445 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2015-02-11 00:08:15,445 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1051448481_0004_m_000000_0' done.
2015-02-11 00:08:15,445 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1051448481_0004_m_000000_0
2015-02-11 00:08:15,446 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:08:15,446 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:08:15,446 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1051448481_0004_r_000000_0
2015-02-11 00:08:15,449 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:15,449 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@3c5d33e1
2015-02-11 00:08:15,450 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:08:15,451 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1051448481_0004_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:08:15,453 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#4 about to shuffle output of map attempt_local1051448481_0004_m_000000_0 decomp: 705 len: 709 to MEMORY
2015-02-11 00:08:15,453 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 705 bytes from map-output for attempt_local1051448481_0004_m_000000_0
2015-02-11 00:08:15,454 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 705, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->705
2015-02-11 00:08:15,454 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:08:15,456 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:15,456 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:08:15,459 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:15,459 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 700 bytes
2015-02-11 00:08:15,462 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 705 bytes to disk to satisfy reduce memory limit
2015-02-11 00:08:15,462 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 709 bytes from disk
2015-02-11 00:08:15,462 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:08:15,463 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:15,463 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 700 bytes
2015-02-11 00:08:15,464 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:15,465 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:08:15,465 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:08:15,474 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:15,474 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_null_false_false"]
2015-02-11 00:08:15,492 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local1051448481_0004_r_000000_0 is done. And is in the process of committing
2015-02-11 00:08:15,494 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:15,494 INFO mapred.Task (Task.java:commit(1162)) - Task attempt_local1051448481_0004_r_000000_0 is allowed to commit now
2015-02-11 00:08:15,495 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1051448481_0004_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_null_false_false/_temporary/0/task_local1051448481_0004_r_000000
2015-02-11 00:08:15,497 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:08:15,497 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1051448481_0004_r_000000_0' done.
2015-02-11 00:08:15,497 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1051448481_0004_r_000000_0
2015-02-11 00:08:15,498 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:08:15,519 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_null_false_false/_temporary
2015-02-11 00:08:15,549 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:15,571 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:08:15,572 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:08:15,584 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:08:15,589 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:08:15,590 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:08:15,599 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting
2015-02-11 00:08:15,599 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:15,599 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_null_true_false"]
2015-02-11 00:08:15,600 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] parallel execution is enabled: false
2015-02-11 00:08:15,600 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting jobs: 1
2015-02-11 00:08:15,600 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] allocating threads: 1
2015-02-11 00:08:15,601 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...ive/false_null_true_false
2015-02-11 00:08:15,602 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:15,603 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:15,641 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:15,663 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:08:15,697 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local343552337_0005
2015-02-11 00:08:15,712 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity343552337/.staging/job_local343552337_0005/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:15,713 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity343552337/.staging/job_local343552337_0005/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:15,758 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local343552337_0005/job_local343552337_0005.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:15,760 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local343552337_0005/job_local343552337_0005.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:15,760 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:08:15,761 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local343552337_0005
2015-02-11 00:08:15,761 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-02-11 00:08:15,761 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:08:15,761 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:08:15,765 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:08:15,766 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local343552337_0005_m_000000_0
2015-02-11 00:08:15,768 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:15,770 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt
2015-02-11 00:08:15,770 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@6b59cf26
2015-02-11 00:08:15,772 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:08:15,773 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:08:15,792 INFO mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:08:15,793 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:08:15,793 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:08:15,794 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:08:15,794 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:08:15,796 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:08:15,797 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:08:15,810 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:15,810 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:15,818 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-11 00:08:15,818 INFO mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:08:15,818 INFO mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:08:15,818 INFO mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 629; bufvoid = 104857600
2015-02-11 00:08:15,818 INFO mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2015-02-11 00:08:15,823 INFO mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:08:15,826 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local343552337_0005_m_000000_0 is done. And is in the process of committing
2015-02-11 00:08:15,828 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2015-02-11 00:08:15,828 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local343552337_0005_m_000000_0' done.
2015-02-11 00:08:15,829 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local343552337_0005_m_000000_0
2015-02-11 00:08:15,829 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:08:15,829 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:08:15,830 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local343552337_0005_r_000000_0
2015-02-11 00:08:15,832 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:15,832 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@46ffeba4
2015-02-11 00:08:15,833 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:08:15,834 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local343552337_0005_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:08:15,835 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#5 about to shuffle output of map attempt_local343552337_0005_m_000000_0 decomp: 705 len: 709 to MEMORY
2015-02-11 00:08:15,836 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 705 bytes from map-output for attempt_local343552337_0005_m_000000_0
2015-02-11 00:08:15,836 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 705, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->705
2015-02-11 00:08:15,837 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:08:15,838 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:15,838 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:08:15,843 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:15,843 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 700 bytes
2015-02-11 00:08:15,845 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 705 bytes to disk to satisfy reduce memory limit
2015-02-11 00:08:15,846 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 709 bytes from disk
2015-02-11 00:08:15,846 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:08:15,846 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:15,846 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 700 bytes
2015-02-11 00:08:15,847 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:15,847 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:08:15,848 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:08:15,856 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:15,856 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_null_true_false"]
2015-02-11 00:08:15,873 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local343552337_0005_r_000000_0 is done. And is in the process of committing
2015-02-11 00:08:15,875 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:15,875 INFO mapred.Task (Task.java:commit(1162)) - Task attempt_local343552337_0005_r_000000_0 is allowed to commit now
2015-02-11 00:08:15,876 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local343552337_0005_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_null_true_false/_temporary/0/task_local343552337_0005_r_000000
2015-02-11 00:08:15,877 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:08:15,878 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local343552337_0005_r_000000_0' done.
2015-02-11 00:08:15,878 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local343552337_0005_r_000000_0
2015-02-11 00:08:15,878 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:08:15,902 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_null_true_false/_temporary
2015-02-11 00:08:15,930 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:15,951 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:08:15,951 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:08:15,963 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:08:15,967 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:08:15,968 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:08:15,976 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting
2015-02-11 00:08:15,977 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:15,977 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_null_true_false"]
2015-02-11 00:08:15,977 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] parallel execution is enabled: false
2015-02-11 00:08:15,977 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting jobs: 1
2015-02-11 00:08:15,977 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] allocating threads: 1
2015-02-11 00:08:15,978 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...sive/true_null_true_false
2015-02-11 00:08:15,979 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:15,980 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:16,009 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:16,036 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:08:16,054 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local2061963434_0006
2015-02-11 00:08:16,069 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity2061963434/.staging/job_local2061963434_0006/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:16,070 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity2061963434/.staging/job_local2061963434_0006/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:16,116 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2061963434_0006/job_local2061963434_0006.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:16,117 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2061963434_0006/job_local2061963434_0006.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:16,118 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:08:16,118 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local2061963434_0006
2015-02-11 00:08:16,118 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:08:16,119 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-02-11 00:08:16,119 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:08:16,122 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:08:16,123 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local2061963434_0006_m_000000_0
2015-02-11 00:08:16,125 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:16,127 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt
2015-02-11 00:08:16,128 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@5ef23a26
2015-02-11 00:08:16,129 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:08:16,130 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:08:16,148 INFO mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:08:16,149 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:08:16,150 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:08:16,150 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:08:16,151 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:08:16,153 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:08:16,153 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:08:16,165 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:16,166 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:16,173 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-11 00:08:16,173 INFO mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:08:16,173 INFO mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:08:16,173 INFO mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 629; bufvoid = 104857600
2015-02-11 00:08:16,173 INFO mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2015-02-11 00:08:18,712 INFO mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:08:18,715 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local2061963434_0006_m_000000_0 is done. And is in the process of committing
2015-02-11 00:08:18,718 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2015-02-11 00:08:18,718 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local2061963434_0006_m_000000_0' done.
2015-02-11 00:08:18,718 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local2061963434_0006_m_000000_0
2015-02-11 00:08:18,718 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:08:18,719 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:08:18,719 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local2061963434_0006_r_000000_0
2015-02-11 00:08:18,721 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:18,722 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@2da0ae6d
2015-02-11 00:08:18,723 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:08:18,724 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local2061963434_0006_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:08:18,726 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#6 about to shuffle output of map attempt_local2061963434_0006_m_000000_0 decomp: 705 len: 709 to MEMORY
2015-02-11 00:08:18,727 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 705 bytes from map-output for attempt_local2061963434_0006_m_000000_0
2015-02-11 00:08:18,727 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 705, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->705
2015-02-11 00:08:18,729 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:08:18,731 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:18,731 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:08:18,734 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:18,735 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 700 bytes
2015-02-11 00:08:18,738 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 705 bytes to disk to satisfy reduce memory limit
2015-02-11 00:08:18,738 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 709 bytes from disk
2015-02-11 00:08:18,738 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:08:18,739 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:18,739 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 700 bytes
2015-02-11 00:08:18,740 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:18,740 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:08:18,741 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:08:18,749 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:18,749 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_null_true_false"]
2015-02-11 00:08:18,766 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local2061963434_0006_r_000000_0 is done. And is in the process of committing
2015-02-11 00:08:18,768 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:18,768 INFO mapred.Task (Task.java:commit(1162)) - Task attempt_local2061963434_0006_r_000000_0 is allowed to commit now
2015-02-11 00:08:18,769 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local2061963434_0006_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_null_true_false/_temporary/0/task_local2061963434_0006_r_000000
2015-02-11 00:08:18,771 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:08:18,771 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local2061963434_0006_r_000000_0' done.
2015-02-11 00:08:18,771 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local2061963434_0006_r_000000_0
2015-02-11 00:08:18,772 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:08:18,791 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_null_true_false/_temporary
2015-02-11 00:08:18,819 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:18,841 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:08:18,850 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:08:18,862 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:08:18,866 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:08:18,868 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:08:18,878 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting
2015-02-11 00:08:18,879 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:18,879 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_false_false_false"]
2015-02-11 00:08:18,879 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] parallel execution is enabled: false
2015-02-11 00:08:18,880 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting jobs: 1
2015-02-11 00:08:18,880 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] allocating threads: 1
2015-02-11 00:08:18,881 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...e/false_false_false_false
2015-02-11 00:08:18,882 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:18,883 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:18,913 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:18,935 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:08:18,953 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1908866090_0007
2015-02-11 00:08:18,969 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1908866090/.staging/job_local1908866090_0007/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:18,970 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1908866090/.staging/job_local1908866090_0007/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:19,018 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1908866090_0007/job_local1908866090_0007.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:19,019 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1908866090_0007/job_local1908866090_0007.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:19,020 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:08:19,020 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local1908866090_0007
2015-02-11 00:08:19,021 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:08:19,021 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-02-11 00:08:19,021 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:08:19,024 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:08:19,025 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1908866090_0007_m_000000_0
2015-02-11 00:08:19,027 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:19,029 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt
2015-02-11 00:08:19,029 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@7ca9bd
2015-02-11 00:08:19,031 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:08:19,031 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:08:19,050 INFO mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:08:19,050 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:08:19,050 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:08:19,051 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:08:19,051 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:08:19,053 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:08:19,053 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:08:19,063 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:19,063 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:19,071 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-11 00:08:19,071 INFO mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:08:19,071 INFO mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:08:19,071 INFO mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 888; bufvoid = 104857600
2015-02-11 00:08:19,071 INFO mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2015-02-11 00:08:19,078 INFO mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:08:19,080 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local1908866090_0007_m_000000_0 is done. And is in the process of committing
2015-02-11 00:08:19,083 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2015-02-11 00:08:19,083 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1908866090_0007_m_000000_0' done.
2015-02-11 00:08:19,083 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1908866090_0007_m_000000_0
2015-02-11 00:08:19,084 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:08:19,084 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:08:19,084 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1908866090_0007_r_000000_0
2015-02-11 00:08:19,087 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:19,087 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@1e450448
2015-02-11 00:08:19,088 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:08:19,089 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1908866090_0007_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:08:19,091 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#7 about to shuffle output of map attempt_local1908866090_0007_m_000000_0 decomp: 964 len: 968 to MEMORY
2015-02-11 00:08:19,092 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 964 bytes from map-output for attempt_local1908866090_0007_m_000000_0
2015-02-11 00:08:19,092 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 964, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->964
2015-02-11 00:08:19,092 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:08:19,093 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:19,094 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:08:19,096 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:19,097 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2015-02-11 00:08:19,099 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 964 bytes to disk to satisfy reduce memory limit
2015-02-11 00:08:19,099 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 968 bytes from disk
2015-02-11 00:08:19,100 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:08:19,100 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:19,100 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2015-02-11 00:08:19,101 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:19,102 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:08:19,102 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:08:19,110 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:19,110 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_false_false_false"]
2015-02-11 00:08:19,129 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local1908866090_0007_r_000000_0 is done. And is in the process of committing
2015-02-11 00:08:19,133 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:19,133 INFO mapred.Task (Task.java:commit(1162)) - Task attempt_local1908866090_0007_r_000000_0 is allowed to commit now
2015-02-11 00:08:19,134 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1908866090_0007_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_false_false_false/_temporary/0/task_local1908866090_0007_r_000000
2015-02-11 00:08:19,135 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:08:19,136 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1908866090_0007_r_000000_0' done.
2015-02-11 00:08:19,136 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1908866090_0007_r_000000_0
2015-02-11 00:08:19,136 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:08:19,160 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_false_false_false/_temporary
2015-02-11 00:08:19,190 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:19,212 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:08:19,213 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:08:19,232 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:08:19,236 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:08:19,237 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:08:19,246 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting
2015-02-11 00:08:19,246 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:19,247 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_false_false_false"]
2015-02-11 00:08:19,247 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] parallel execution is enabled: false
2015-02-11 00:08:19,248 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting jobs: 1
2015-02-11 00:08:19,248 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] allocating threads: 1
2015-02-11 00:08:19,249 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...ve/true_false_false_false
2015-02-11 00:08:19,250 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:19,251 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:19,278 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:19,300 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:08:19,319 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local174420582_0008
2015-02-11 00:08:19,334 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity174420582/.staging/job_local174420582_0008/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:19,335 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity174420582/.staging/job_local174420582_0008/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:19,381 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local174420582_0008/job_local174420582_0008.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:19,383 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local174420582_0008/job_local174420582_0008.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:19,383 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:08:19,384 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local174420582_0008
2015-02-11 00:08:19,384 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:08:19,384 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-02-11 00:08:19,384 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:08:19,388 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:08:19,388 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local174420582_0008_m_000000_0
2015-02-11 00:08:19,390 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:19,392 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt
2015-02-11 00:08:19,392 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@5c04e904
2015-02-11 00:08:19,393 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:08:19,394 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:08:19,411 INFO mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:08:19,412 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:08:19,412 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:08:19,412 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:08:19,412 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:08:19,414 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:08:19,414 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:08:19,423 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:19,423 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:19,430 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-11 00:08:19,431 INFO mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:08:19,431 INFO mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:08:19,431 INFO mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 888; bufvoid = 104857600
2015-02-11 00:08:19,431 INFO mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2015-02-11 00:08:23,078 INFO mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:08:23,086 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local174420582_0008_m_000000_0 is done. And is in the process of committing
2015-02-11 00:08:23,089 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2015-02-11 00:08:23,089 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local174420582_0008_m_000000_0' done.
2015-02-11 00:08:23,089 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local174420582_0008_m_000000_0
2015-02-11 00:08:23,090 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:08:23,090 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:08:23,091 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local174420582_0008_r_000000_0
2015-02-11 00:08:23,093 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:23,093 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@3646aa61
2015-02-11 00:08:23,095 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:08:23,096 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local174420582_0008_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:08:23,098 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#8 about to shuffle output of map attempt_local174420582_0008_m_000000_0 decomp: 964 len: 968 to MEMORY
2015-02-11 00:08:23,098 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 964 bytes from map-output for attempt_local174420582_0008_m_000000_0
2015-02-11 00:08:23,099 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 964, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->964
2015-02-11 00:08:23,100 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:08:23,101 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:23,101 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:08:23,105 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:23,105 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2015-02-11 00:08:23,108 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 964 bytes to disk to satisfy reduce memory limit
2015-02-11 00:08:23,109 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 968 bytes from disk
2015-02-11 00:08:23,109 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:08:23,110 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:23,110 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2015-02-11 00:08:23,111 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:23,112 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:08:23,113 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:08:23,121 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:23,121 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_false_false_false"]
2015-02-11 00:08:23,139 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local174420582_0008_r_000000_0 is done. And is in the process of committing
2015-02-11 00:08:23,141 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:23,141 INFO mapred.Task (Task.java:commit(1162)) - Task attempt_local174420582_0008_r_000000_0 is allowed to commit now
2015-02-11 00:08:23,142 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local174420582_0008_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_false_false_false/_temporary/0/task_local174420582_0008_r_000000
2015-02-11 00:08:23,144 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:08:23,144 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local174420582_0008_r_000000_0' done.
2015-02-11 00:08:23,145 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local174420582_0008_r_000000_0
2015-02-11 00:08:23,145 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:08:23,166 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_false_false_false/_temporary
2015-02-11 00:08:23,195 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:23,219 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:08:23,219 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:08:23,232 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:08:23,235 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:08:23,235 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:08:23,246 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting
2015-02-11 00:08:23,247 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:23,247 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_true_false_false"]
2015-02-11 00:08:23,247 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] parallel execution is enabled: false
2015-02-11 00:08:23,247 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting jobs: 1
2015-02-11 00:08:23,247 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] allocating threads: 1
2015-02-11 00:08:23,248 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...ive/true_true_false_false
2015-02-11 00:08:23,249 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:23,250 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:23,278 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:23,301 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:08:23,318 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1268536966_0009
2015-02-11 00:08:23,334 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1268536966/.staging/job_local1268536966_0009/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:23,335 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1268536966/.staging/job_local1268536966_0009/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:23,380 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1268536966_0009/job_local1268536966_0009.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:23,381 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1268536966_0009/job_local1268536966_0009.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:23,382 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:08:23,382 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local1268536966_0009
2015-02-11 00:08:23,382 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-02-11 00:08:23,383 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:08:23,384 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:08:23,387 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:08:23,387 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1268536966_0009_m_000000_0
2015-02-11 00:08:23,390 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:23,391 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt
2015-02-11 00:08:23,391 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@3af5f6dc
2015-02-11 00:08:23,393 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:08:23,393 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:08:23,412 INFO mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:08:23,412 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:08:23,412 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:08:23,412 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:08:23,413 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:08:23,415 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:08:23,415 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:08:23,425 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:23,425 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:23,432 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-11 00:08:23,432 INFO mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:08:23,432 INFO mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:08:23,433 INFO mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 888; bufvoid = 104857600
2015-02-11 00:08:23,433 INFO mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2015-02-11 00:08:27,990 INFO mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:08:27,993 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local1268536966_0009_m_000000_0 is done. And is in the process of committing
2015-02-11 00:08:27,995 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2015-02-11 00:08:27,996 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1268536966_0009_m_000000_0' done.
2015-02-11 00:08:27,996 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1268536966_0009_m_000000_0
2015-02-11 00:08:27,996 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:08:27,997 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:08:27,997 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1268536966_0009_r_000000_0
2015-02-11 00:08:27,999 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:28,000 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@3994e3fe
2015-02-11 00:08:28,001 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:08:28,002 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1268536966_0009_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:08:28,004 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#9 about to shuffle output of map attempt_local1268536966_0009_m_000000_0 decomp: 964 len: 968 to MEMORY
2015-02-11 00:08:28,005 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 964 bytes from map-output for attempt_local1268536966_0009_m_000000_0
2015-02-11 00:08:28,005 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 964, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->964
2015-02-11 00:08:28,006 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:08:28,007 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:28,007 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:08:28,011 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:28,011 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2015-02-11 00:08:28,013 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 964 bytes to disk to satisfy reduce memory limit
2015-02-11 00:08:28,014 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 968 bytes from disk
2015-02-11 00:08:28,014 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:08:28,014 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:28,014 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2015-02-11 00:08:28,015 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:28,016 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:08:28,016 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:08:28,025 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:28,025 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_true_false_false"]
2015-02-11 00:08:28,042 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local1268536966_0009_r_000000_0 is done. And is in the process of committing
2015-02-11 00:08:28,043 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:28,044 INFO mapred.Task (Task.java:commit(1162)) - Task attempt_local1268536966_0009_r_000000_0 is allowed to commit now
2015-02-11 00:08:28,046 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1268536966_0009_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_true_false_false/_temporary/0/task_local1268536966_0009_r_000000
2015-02-11 00:08:28,047 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:08:28,047 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1268536966_0009_r_000000_0' done.
2015-02-11 00:08:28,047 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1268536966_0009_r_000000_0
2015-02-11 00:08:28,048 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:08:28,071 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_true_false_false/_temporary
2015-02-11 00:08:28,105 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:28,143 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:08:28,145 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:08:28,155 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:08:28,158 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:08:28,159 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:08:28,167 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting
2015-02-11 00:08:28,168 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:28,168 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_true_false_false"]
2015-02-11 00:08:28,168 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] parallel execution is enabled: false
2015-02-11 00:08:28,168 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting jobs: 1
2015-02-11 00:08:28,168 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] allocating threads: 1
2015-02-11 00:08:28,169 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...ve/false_true_false_false
2015-02-11 00:08:28,170 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:28,171 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:28,198 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:28,220 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:08:28,238 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local262738150_0010
2015-02-11 00:08:28,254 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity262738150/.staging/job_local262738150_0010/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:28,255 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity262738150/.staging/job_local262738150_0010/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:28,301 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local262738150_0010/job_local262738150_0010.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:28,303 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local262738150_0010/job_local262738150_0010.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:28,304 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:08:28,305 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local262738150_0010
2015-02-11 00:08:28,305 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:08:28,305 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:08:28,305 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-02-11 00:08:28,309 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:08:28,309 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local262738150_0010_m_000000_0
2015-02-11 00:08:28,311 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:28,313 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt
2015-02-11 00:08:28,313 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@771eeb
2015-02-11 00:08:28,315 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:08:28,315 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:08:28,334 INFO mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:08:28,335 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:08:28,335 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:08:28,335 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:08:28,335 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:08:28,337 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:08:28,337 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:08:28,347 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:28,347 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:28,354 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-11 00:08:28,355 INFO mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:08:28,355 INFO mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:08:28,355 INFO mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 888; bufvoid = 104857600
2015-02-11 00:08:28,355 INFO mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2015-02-11 00:08:30,716 INFO mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:08:30,719 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local262738150_0010_m_000000_0 is done. And is in the process of committing
2015-02-11 00:08:30,721 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2015-02-11 00:08:30,721 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local262738150_0010_m_000000_0' done.
2015-02-11 00:08:30,721 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local262738150_0010_m_000000_0
2015-02-11 00:08:30,721 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:08:30,722 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:08:30,722 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local262738150_0010_r_000000_0
2015-02-11 00:08:30,724 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:30,724 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@7002ee59
2015-02-11 00:08:30,725 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:08:30,726 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local262738150_0010_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:08:30,728 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#10 about to shuffle output of map attempt_local262738150_0010_m_000000_0 decomp: 964 len: 968 to MEMORY
2015-02-11 00:08:30,728 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 964 bytes from map-output for attempt_local262738150_0010_m_000000_0
2015-02-11 00:08:30,729 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 964, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->964
2015-02-11 00:08:30,729 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:08:30,730 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:30,731 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:08:30,733 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:30,734 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2015-02-11 00:08:30,736 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 964 bytes to disk to satisfy reduce memory limit
2015-02-11 00:08:30,736 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 968 bytes from disk
2015-02-11 00:08:30,736 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:08:30,736 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:30,737 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2015-02-11 00:08:30,738 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:30,738 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:08:30,738 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:08:30,746 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:30,746 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_true_false_false"]
2015-02-11 00:08:30,762 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local262738150_0010_r_000000_0 is done. And is in the process of committing
2015-02-11 00:08:30,764 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:30,764 INFO mapred.Task (Task.java:commit(1162)) - Task attempt_local262738150_0010_r_000000_0 is allowed to commit now
2015-02-11 00:08:30,765 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local262738150_0010_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_true_false_false/_temporary/0/task_local262738150_0010_r_000000
2015-02-11 00:08:30,766 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:08:30,767 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local262738150_0010_r_000000_0' done.
2015-02-11 00:08:30,767 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local262738150_0010_r_000000_0
2015-02-11 00:08:30,767 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:08:30,794 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_true_false_false/_temporary
2015-02-11 00:08:30,822 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:30,846 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:08:30,846 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:08:30,856 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:08:30,859 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:08:30,860 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:08:30,868 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting
2015-02-11 00:08:30,869 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:30,869 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_false_true_false"]
2015-02-11 00:08:30,869 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] parallel execution is enabled: false
2015-02-11 00:08:30,869 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting jobs: 1
2015-02-11 00:08:30,870 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] allocating threads: 1
2015-02-11 00:08:30,870 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...ve/false_false_true_false
2015-02-11 00:08:30,871 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:30,872 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:30,899 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:30,920 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:08:30,937 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1284582980_0011
2015-02-11 00:08:30,952 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1284582980/.staging/job_local1284582980_0011/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:30,953 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1284582980/.staging/job_local1284582980_0011/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:30,997 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1284582980_0011/job_local1284582980_0011.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:30,998 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1284582980_0011/job_local1284582980_0011.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:30,999 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:08:30,999 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local1284582980_0011
2015-02-11 00:08:30,999 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-02-11 00:08:31,000 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:08:31,000 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:08:31,003 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:08:31,004 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1284582980_0011_m_000000_0
2015-02-11 00:08:31,006 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:31,007 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt
2015-02-11 00:08:31,008 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@509ad4be
2015-02-11 00:08:31,009 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:08:31,010 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:08:31,044 INFO mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:08:31,044 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:08:31,044 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:08:31,044 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:08:31,044 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:08:31,046 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:08:31,046 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:08:31,055 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:31,055 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:31,062 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-11 00:08:31,062 INFO mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:08:31,062 INFO mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:08:31,062 INFO mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 888; bufvoid = 104857600
2015-02-11 00:08:31,062 INFO mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2015-02-11 00:08:31,068 INFO mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:08:31,070 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local1284582980_0011_m_000000_0 is done. And is in the process of committing
2015-02-11 00:08:31,072 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2015-02-11 00:08:31,072 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1284582980_0011_m_000000_0' done.
2015-02-11 00:08:31,072 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1284582980_0011_m_000000_0
2015-02-11 00:08:31,073 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:08:31,073 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:08:31,074 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1284582980_0011_r_000000_0
2015-02-11 00:08:31,076 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:31,076 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@75471dd2
2015-02-11 00:08:31,077 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:08:31,079 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1284582980_0011_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:08:31,081 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#11 about to shuffle output of map attempt_local1284582980_0011_m_000000_0 decomp: 964 len: 968 to MEMORY
2015-02-11 00:08:31,081 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 964 bytes from map-output for attempt_local1284582980_0011_m_000000_0
2015-02-11 00:08:31,082 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 964, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->964
2015-02-11 00:08:31,082 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:08:31,083 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:31,084 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:08:31,086 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:31,086 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2015-02-11 00:08:31,088 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 964 bytes to disk to satisfy reduce memory limit
2015-02-11 00:08:31,089 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 968 bytes from disk
2015-02-11 00:08:31,089 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:08:31,089 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:31,090 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2015-02-11 00:08:31,091 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:31,091 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:08:31,091 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:08:31,099 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:31,099 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_false_true_false"]
2015-02-11 00:08:31,115 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local1284582980_0011_r_000000_0 is done. And is in the process of committing
2015-02-11 00:08:31,117 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:31,117 INFO mapred.Task (Task.java:commit(1162)) - Task attempt_local1284582980_0011_r_000000_0 is allowed to commit now
2015-02-11 00:08:31,118 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1284582980_0011_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_false_true_false/_temporary/0/task_local1284582980_0011_r_000000
2015-02-11 00:08:31,120 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:08:31,120 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1284582980_0011_r_000000_0' done.
2015-02-11 00:08:31,120 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1284582980_0011_r_000000_0
2015-02-11 00:08:31,120 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:08:31,142 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_false_true_false/_temporary
2015-02-11 00:08:31,170 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:31,192 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:08:31,192 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:08:31,201 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:08:31,203 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:08:31,204 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:08:31,211 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting
2015-02-11 00:08:31,211 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:31,211 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_false_true_false"]
2015-02-11 00:08:31,211 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] parallel execution is enabled: false
2015-02-11 00:08:31,212 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting jobs: 1
2015-02-11 00:08:31,212 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] allocating threads: 1
2015-02-11 00:08:31,212 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...ive/true_false_true_false
2015-02-11 00:08:31,213 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:31,214 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:31,240 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:31,261 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:08:31,277 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local824931114_0012
2015-02-11 00:08:31,291 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity824931114/.staging/job_local824931114_0012/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:31,292 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity824931114/.staging/job_local824931114_0012/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:31,337 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local824931114_0012/job_local824931114_0012.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:31,338 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local824931114_0012/job_local824931114_0012.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:31,339 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:08:31,340 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local824931114_0012
2015-02-11 00:08:31,340 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:08:31,340 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-02-11 00:08:31,340 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:08:31,344 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:08:31,344 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local824931114_0012_m_000000_0
2015-02-11 00:08:31,346 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:31,347 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt
2015-02-11 00:08:31,348 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@389d0b87
2015-02-11 00:08:31,349 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:08:31,350 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:08:31,375 INFO mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:08:31,375 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:08:31,376 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:08:31,376 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:08:31,376 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:08:31,381 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:08:31,381 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:08:31,390 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:31,390 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:31,397 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-11 00:08:31,398 INFO mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:08:31,398 INFO mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:08:31,398 INFO mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 888; bufvoid = 104857600
2015-02-11 00:08:31,398 INFO mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2015-02-11 00:08:35,086 INFO mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:08:35,089 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local824931114_0012_m_000000_0 is done. And is in the process of committing
2015-02-11 00:08:35,091 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2015-02-11 00:08:35,091 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local824931114_0012_m_000000_0' done.
2015-02-11 00:08:35,091 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local824931114_0012_m_000000_0
2015-02-11 00:08:35,091 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:08:35,092 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:08:35,092 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local824931114_0012_r_000000_0
2015-02-11 00:08:35,095 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:35,095 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@6c08ffaf
2015-02-11 00:08:35,097 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:08:35,098 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local824931114_0012_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:08:35,100 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#12 about to shuffle output of map attempt_local824931114_0012_m_000000_0 decomp: 964 len: 968 to MEMORY
2015-02-11 00:08:35,100 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 964 bytes from map-output for attempt_local824931114_0012_m_000000_0
2015-02-11 00:08:35,101 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 964, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->964
2015-02-11 00:08:35,101 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:08:35,103 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:35,103 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:08:35,106 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:35,106 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2015-02-11 00:08:35,109 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 964 bytes to disk to satisfy reduce memory limit
2015-02-11 00:08:35,109 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 968 bytes from disk
2015-02-11 00:08:35,109 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:08:35,109 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:35,110 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2015-02-11 00:08:35,111 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:35,112 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:08:35,112 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:08:35,120 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:35,120 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_false_true_false"]
2015-02-11 00:08:35,136 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local824931114_0012_r_000000_0 is done. And is in the process of committing
2015-02-11 00:08:35,138 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:35,138 INFO mapred.Task (Task.java:commit(1162)) - Task attempt_local824931114_0012_r_000000_0 is allowed to commit now
2015-02-11 00:08:35,139 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local824931114_0012_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_false_true_false/_temporary/0/task_local824931114_0012_r_000000
2015-02-11 00:08:35,140 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:08:35,140 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local824931114_0012_r_000000_0' done.
2015-02-11 00:08:35,140 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local824931114_0012_r_000000_0
2015-02-11 00:08:35,141 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:08:35,165 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_false_true_false/_temporary
2015-02-11 00:08:35,193 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:35,215 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:08:35,215 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:08:35,224 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:08:35,227 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:08:35,228 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:08:35,235 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting
2015-02-11 00:08:35,236 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:35,236 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_true_true_false"]
2015-02-11 00:08:35,236 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] parallel execution is enabled: false
2015-02-11 00:08:35,236 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting jobs: 1
2015-02-11 00:08:35,236 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] allocating threads: 1
2015-02-11 00:08:35,238 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...sive/true_true_true_false
2015-02-11 00:08:35,239 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:35,240 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:35,265 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:35,286 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:08:35,303 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1825914602_0013
2015-02-11 00:08:35,318 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1825914602/.staging/job_local1825914602_0013/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:35,319 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1825914602/.staging/job_local1825914602_0013/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:35,363 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1825914602_0013/job_local1825914602_0013.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:35,364 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1825914602_0013/job_local1825914602_0013.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:35,365 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:08:35,366 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:08:35,366 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:08:35,367 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local1825914602_0013
2015-02-11 00:08:35,367 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-02-11 00:08:35,370 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:08:35,370 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1825914602_0013_m_000000_0
2015-02-11 00:08:35,372 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:35,373 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt
2015-02-11 00:08:35,373 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@66e04981
2015-02-11 00:08:35,374 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:08:35,375 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:08:35,397 INFO mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:08:35,397 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:08:35,397 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:08:35,397 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:08:35,397 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:08:35,400 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:08:35,400 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:08:35,408 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:35,408 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:35,415 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-11 00:08:35,415 INFO mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:08:35,415 INFO mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:08:35,415 INFO mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 888; bufvoid = 104857600
2015-02-11 00:08:35,415 INFO mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2015-02-11 00:08:40,036 INFO mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:08:40,038 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local1825914602_0013_m_000000_0 is done. And is in the process of committing
2015-02-11 00:08:40,040 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2015-02-11 00:08:40,040 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1825914602_0013_m_000000_0' done.
2015-02-11 00:08:40,041 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1825914602_0013_m_000000_0
2015-02-11 00:08:40,041 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:08:40,041 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:08:40,041 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1825914602_0013_r_000000_0
2015-02-11 00:08:40,043 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:40,043 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@17a32ecd
2015-02-11 00:08:40,044 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:08:40,045 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1825914602_0013_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:08:40,046 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#13 about to shuffle output of map attempt_local1825914602_0013_m_000000_0 decomp: 964 len: 968 to MEMORY
2015-02-11 00:08:40,047 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 964 bytes from map-output for attempt_local1825914602_0013_m_000000_0
2015-02-11 00:08:40,047 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 964, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->964
2015-02-11 00:08:40,048 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:08:40,049 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:40,050 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:08:40,058 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:40,058 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2015-02-11 00:08:40,060 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 964 bytes to disk to satisfy reduce memory limit
2015-02-11 00:08:40,060 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 968 bytes from disk
2015-02-11 00:08:40,060 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:08:40,061 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:40,061 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2015-02-11 00:08:40,062 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:40,062 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:08:40,063 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:08:40,070 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:40,070 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_true_true_false"]
2015-02-11 00:08:40,086 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local1825914602_0013_r_000000_0 is done. And is in the process of committing
2015-02-11 00:08:40,087 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:40,087 INFO mapred.Task (Task.java:commit(1162)) - Task attempt_local1825914602_0013_r_000000_0 is allowed to commit now
2015-02-11 00:08:40,112 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1825914602_0013_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_true_true_false/_temporary/0/task_local1825914602_0013_r_000000
2015-02-11 00:08:40,113 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:08:40,114 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1825914602_0013_r_000000_0' done.
2015-02-11 00:08:40,114 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1825914602_0013_r_000000_0
2015-02-11 00:08:40,114 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:08:40,136 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_true_true_false/_temporary
2015-02-11 00:08:40,164 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:40,183 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:08:40,183 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:08:40,191 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:08:40,194 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:08:40,194 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:08:40,201 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting
2015-02-11 00:08:40,201 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:40,201 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_true_true_false"]
2015-02-11 00:08:40,201 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] parallel execution is enabled: false
2015-02-11 00:08:40,202 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting jobs: 1
2015-02-11 00:08:40,202 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] allocating threads: 1
2015-02-11 00:08:40,202 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...ive/false_true_true_false
2015-02-11 00:08:40,203 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:40,206 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:40,232 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:40,251 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:08:40,267 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1075528721_0014
2015-02-11 00:08:40,282 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1075528721/.staging/job_local1075528721_0014/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:40,282 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1075528721/.staging/job_local1075528721_0014/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:40,324 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1075528721_0014/job_local1075528721_0014.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:40,325 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1075528721_0014/job_local1075528721_0014.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:40,326 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:08:40,326 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local1075528721_0014
2015-02-11 00:08:40,326 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:08:40,327 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-02-11 00:08:40,327 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:08:40,330 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:08:40,330 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1075528721_0014_m_000000_0
2015-02-11 00:08:40,332 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:40,334 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt
2015-02-11 00:08:40,334 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@34450563
2015-02-11 00:08:40,335 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:08:40,336 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:08:40,354 INFO mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:08:40,354 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:08:40,354 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:08:40,354 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:08:40,354 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:08:40,357 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:08:40,357 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:08:40,365 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:40,365 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:40,373 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-11 00:08:40,374 INFO mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:08:40,374 INFO mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:08:40,374 INFO mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 888; bufvoid = 104857600
2015-02-11 00:08:40,375 INFO mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2015-02-11 00:08:42,706 INFO mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:08:42,708 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local1075528721_0014_m_000000_0 is done. And is in the process of committing
2015-02-11 00:08:42,710 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2015-02-11 00:08:42,711 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1075528721_0014_m_000000_0' done.
2015-02-11 00:08:42,711 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1075528721_0014_m_000000_0
2015-02-11 00:08:42,711 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:08:42,712 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:08:42,712 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1075528721_0014_r_000000_0
2015-02-11 00:08:42,714 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:42,714 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@31e28608
2015-02-11 00:08:42,715 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:08:42,716 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1075528721_0014_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:08:42,718 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#14 about to shuffle output of map attempt_local1075528721_0014_m_000000_0 decomp: 964 len: 968 to MEMORY
2015-02-11 00:08:42,719 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 964 bytes from map-output for attempt_local1075528721_0014_m_000000_0
2015-02-11 00:08:42,719 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 964, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->964
2015-02-11 00:08:42,719 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:08:42,720 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:42,721 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:08:42,724 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:42,724 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2015-02-11 00:08:42,727 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 964 bytes to disk to satisfy reduce memory limit
2015-02-11 00:08:42,727 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 968 bytes from disk
2015-02-11 00:08:42,728 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:08:42,728 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:42,729 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2015-02-11 00:08:42,730 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:42,730 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:08:42,730 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:08:42,738 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:42,738 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_true_true_false"]
2015-02-11 00:08:42,754 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local1075528721_0014_r_000000_0 is done. And is in the process of committing
2015-02-11 00:08:42,756 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:42,756 INFO mapred.Task (Task.java:commit(1162)) - Task attempt_local1075528721_0014_r_000000_0 is allowed to commit now
2015-02-11 00:08:42,756 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1075528721_0014_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_true_true_false/_temporary/0/task_local1075528721_0014_r_000000
2015-02-11 00:08:42,758 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:08:42,758 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1075528721_0014_r_000000_0' done.
2015-02-11 00:08:42,758 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1075528721_0014_r_000000_0
2015-02-11 00:08:42,758 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:08:42,778 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_true_true_false/_temporary
2015-02-11 00:08:42,806 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:42,826 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:08:42,827 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:08:42,835 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:08:42,837 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:08:42,838 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:08:42,843 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting
2015-02-11 00:08:42,844 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:42,844 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_null_false_true"]
2015-02-11 00:08:42,844 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] parallel execution is enabled: false
2015-02-11 00:08:42,844 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting jobs: 1
2015-02-11 00:08:42,844 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] allocating threads: 1
2015-02-11 00:08:42,845 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...ive/false_null_false_true
2015-02-11 00:08:42,846 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:42,847 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:42,872 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:42,891 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:08:42,907 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local45209411_0015
2015-02-11 00:08:42,922 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity45209411/.staging/job_local45209411_0015/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:42,923 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity45209411/.staging/job_local45209411_0015/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:42,966 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local45209411_0015/job_local45209411_0015.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:42,968 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local45209411_0015/job_local45209411_0015.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:42,968 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:08:42,969 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local45209411_0015
2015-02-11 00:08:42,969 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:08:42,969 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-02-11 00:08:42,969 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:08:42,972 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:08:42,972 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local45209411_0015_m_000000_0
2015-02-11 00:08:42,974 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:42,976 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt
2015-02-11 00:08:42,976 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@2d427def
2015-02-11 00:08:42,978 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:08:42,978 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:08:43,003 INFO mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:08:43,003 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:08:43,004 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:08:43,004 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:08:43,004 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:08:43,006 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:08:43,006 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:08:43,016 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:43,016 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:43,022 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-11 00:08:43,022 INFO mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:08:43,022 INFO mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:08:43,022 INFO mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 629; bufvoid = 104857600
2015-02-11 00:08:43,023 INFO mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2015-02-11 00:08:43,026 INFO mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:08:43,028 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local45209411_0015_m_000000_0 is done. And is in the process of committing
2015-02-11 00:08:43,030 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2015-02-11 00:08:43,030 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local45209411_0015_m_000000_0' done.
2015-02-11 00:08:43,030 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local45209411_0015_m_000000_0
2015-02-11 00:08:43,030 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:08:43,031 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:08:43,031 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local45209411_0015_r_000000_0
2015-02-11 00:08:43,033 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:43,034 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@14115e3
2015-02-11 00:08:43,034 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:08:43,035 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local45209411_0015_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:08:43,037 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#15 about to shuffle output of map attempt_local45209411_0015_m_000000_0 decomp: 705 len: 709 to MEMORY
2015-02-11 00:08:43,038 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 705 bytes from map-output for attempt_local45209411_0015_m_000000_0
2015-02-11 00:08:43,038 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 705, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->705
2015-02-11 00:08:43,039 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:08:43,040 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:43,041 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:08:43,043 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:43,043 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 700 bytes
2015-02-11 00:08:43,046 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 705 bytes to disk to satisfy reduce memory limit
2015-02-11 00:08:43,046 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 709 bytes from disk
2015-02-11 00:08:43,046 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:08:43,047 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:43,047 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 700 bytes
2015-02-11 00:08:43,048 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:43,049 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:08:43,049 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:08:43,056 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:43,057 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_null_false_true"]
2015-02-11 00:08:43,072 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local45209411_0015_r_000000_0 is done. And is in the process of committing
2015-02-11 00:08:43,073 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:43,074 INFO mapred.Task (Task.java:commit(1162)) - Task attempt_local45209411_0015_r_000000_0 is allowed to commit now
2015-02-11 00:08:43,074 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local45209411_0015_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_null_false_true/_temporary/0/task_local45209411_0015_r_000000
2015-02-11 00:08:43,076 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:08:43,076 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local45209411_0015_r_000000_0' done.
2015-02-11 00:08:43,076 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local45209411_0015_r_000000_0
2015-02-11 00:08:43,076 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:08:43,100 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_null_false_true/_temporary
2015-02-11 00:08:43,127 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:43,145 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:08:43,146 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:08:43,155 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:08:43,157 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:08:43,157 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:08:43,164 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting
2015-02-11 00:08:43,165 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:43,165 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_null_false_true"]
2015-02-11 00:08:43,165 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] parallel execution is enabled: false
2015-02-11 00:08:43,165 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting jobs: 1
2015-02-11 00:08:43,165 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] allocating threads: 1
2015-02-11 00:08:43,166 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...sive/true_null_false_true
2015-02-11 00:08:43,166 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:43,167 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:43,192 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:43,211 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:08:43,227 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1301121787_0016
2015-02-11 00:08:43,241 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1301121787/.staging/job_local1301121787_0016/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:43,242 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1301121787/.staging/job_local1301121787_0016/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:43,284 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1301121787_0016/job_local1301121787_0016.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:43,286 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1301121787_0016/job_local1301121787_0016.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:43,286 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:08:43,287 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local1301121787_0016
2015-02-11 00:08:43,287 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:08:43,287 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-02-11 00:08:43,287 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:08:43,290 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:08:43,290 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1301121787_0016_m_000000_0
2015-02-11 00:08:43,292 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:43,293 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt
2015-02-11 00:08:43,293 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@37183a79
2015-02-11 00:08:43,294 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:08:43,295 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:08:43,318 INFO mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:08:43,318 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:08:43,318 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:08:43,318 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:08:43,319 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:08:43,320 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:08:43,321 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:08:43,331 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:43,332 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:43,343 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-11 00:08:43,344 INFO mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:08:43,344 INFO mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:08:43,344 INFO mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 629; bufvoid = 104857600
2015-02-11 00:08:43,344 INFO mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2015-02-11 00:08:43,348 INFO mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:08:43,350 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local1301121787_0016_m_000000_0 is done. And is in the process of committing
2015-02-11 00:08:43,352 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2015-02-11 00:08:43,352 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1301121787_0016_m_000000_0' done.
2015-02-11 00:08:43,352 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1301121787_0016_m_000000_0
2015-02-11 00:08:43,353 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:08:43,353 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:08:43,353 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1301121787_0016_r_000000_0
2015-02-11 00:08:43,355 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:43,356 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@62d2953d
2015-02-11 00:08:43,356 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:08:43,357 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1301121787_0016_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:08:43,359 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#16 about to shuffle output of map attempt_local1301121787_0016_m_000000_0 decomp: 705 len: 709 to MEMORY
2015-02-11 00:08:43,359 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 705 bytes from map-output for attempt_local1301121787_0016_m_000000_0
2015-02-11 00:08:43,360 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 705, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->705
2015-02-11 00:08:43,360 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:08:43,361 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:43,362 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:08:43,365 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:43,365 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 700 bytes
2015-02-11 00:08:43,367 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 705 bytes to disk to satisfy reduce memory limit
2015-02-11 00:08:43,367 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 709 bytes from disk
2015-02-11 00:08:43,368 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:08:43,368 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:43,368 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 700 bytes
2015-02-11 00:08:43,369 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:43,370 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:08:43,370 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:08:43,377 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:43,377 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_null_false_true"]
2015-02-11 00:08:43,393 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local1301121787_0016_r_000000_0 is done. And is in the process of committing
2015-02-11 00:08:43,395 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:43,395 INFO mapred.Task (Task.java:commit(1162)) - Task attempt_local1301121787_0016_r_000000_0 is allowed to commit now
2015-02-11 00:08:43,396 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1301121787_0016_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_null_false_true/_temporary/0/task_local1301121787_0016_r_000000
2015-02-11 00:08:43,397 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:08:43,397 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1301121787_0016_r_000000_0' done.
2015-02-11 00:08:43,397 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1301121787_0016_r_000000_0
2015-02-11 00:08:43,397 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:08:43,415 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_null_false_true/_temporary
2015-02-11 00:08:43,443 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:43,463 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:08:43,464 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:08:43,472 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:08:43,474 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:08:43,474 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:08:43,480 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting
2015-02-11 00:08:43,481 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:43,481 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_null_true_true"]
2015-02-11 00:08:43,481 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] parallel execution is enabled: false
2015-02-11 00:08:43,481 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting jobs: 1
2015-02-11 00:08:43,481 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] allocating threads: 1
2015-02-11 00:08:43,482 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...sive/false_null_true_true
2015-02-11 00:08:43,483 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:43,484 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:43,510 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:43,530 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:08:43,546 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1593700997_0017
2015-02-11 00:08:43,561 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1593700997/.staging/job_local1593700997_0017/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:43,562 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1593700997/.staging/job_local1593700997_0017/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:43,606 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1593700997_0017/job_local1593700997_0017.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:43,607 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1593700997_0017/job_local1593700997_0017.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:43,608 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:08:43,608 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:08:43,608 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:08:43,608 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local1593700997_0017
2015-02-11 00:08:43,609 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-02-11 00:08:43,611 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:08:43,611 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1593700997_0017_m_000000_0
2015-02-11 00:08:43,613 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:43,614 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt
2015-02-11 00:08:43,615 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@779005c4
2015-02-11 00:08:43,616 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:08:43,616 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:08:43,640 INFO mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:08:43,640 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:08:43,640 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:08:43,640 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:08:43,640 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:08:43,642 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:08:43,642 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:08:43,652 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:43,652 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:43,658 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-11 00:08:43,659 INFO mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:08:43,659 INFO mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:08:43,659 INFO mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 629; bufvoid = 104857600
2015-02-11 00:08:43,659 INFO mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2015-02-11 00:08:43,663 INFO mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:08:43,665 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local1593700997_0017_m_000000_0 is done. And is in the process of committing
2015-02-11 00:08:43,667 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2015-02-11 00:08:43,667 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1593700997_0017_m_000000_0' done.
2015-02-11 00:08:43,667 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1593700997_0017_m_000000_0
2015-02-11 00:08:43,667 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:08:43,668 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:08:43,668 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1593700997_0017_r_000000_0
2015-02-11 00:08:43,670 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:43,670 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@3051c45f
2015-02-11 00:08:43,670 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:08:43,671 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1593700997_0017_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:08:43,673 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#17 about to shuffle output of map attempt_local1593700997_0017_m_000000_0 decomp: 705 len: 709 to MEMORY
2015-02-11 00:08:43,673 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 705 bytes from map-output for attempt_local1593700997_0017_m_000000_0
2015-02-11 00:08:43,674 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 705, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->705
2015-02-11 00:08:43,674 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:08:43,675 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:43,675 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:08:43,680 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:43,680 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 700 bytes
2015-02-11 00:08:43,682 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 705 bytes to disk to satisfy reduce memory limit
2015-02-11 00:08:43,683 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 709 bytes from disk
2015-02-11 00:08:43,683 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:08:43,683 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:43,683 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 700 bytes
2015-02-11 00:08:43,684 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:43,684 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:08:43,684 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:08:43,691 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:43,691 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_null_true_true"]
2015-02-11 00:08:43,705 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local1593700997_0017_r_000000_0 is done. And is in the process of committing
2015-02-11 00:08:43,707 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:43,707 INFO mapred.Task (Task.java:commit(1162)) - Task attempt_local1593700997_0017_r_000000_0 is allowed to commit now
2015-02-11 00:08:43,708 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1593700997_0017_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_null_true_true/_temporary/0/task_local1593700997_0017_r_000000
2015-02-11 00:08:43,709 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:08:43,709 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1593700997_0017_r_000000_0' done.
2015-02-11 00:08:43,709 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1593700997_0017_r_000000_0
2015-02-11 00:08:43,710 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:08:43,727 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_null_true_true/_temporary
2015-02-11 00:08:43,755 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:43,774 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:08:43,774 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:08:43,782 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:08:43,784 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:08:43,785 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:08:43,789 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting
2015-02-11 00:08:43,790 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:43,790 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_null_true_true"]
2015-02-11 00:08:43,790 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] parallel execution is enabled: false
2015-02-11 00:08:43,790 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting jobs: 1
2015-02-11 00:08:43,790 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] allocating threads: 1
2015-02-11 00:08:43,791 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...nsive/true_null_true_true
2015-02-11 00:08:43,792 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:43,793 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:43,820 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:43,841 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:08:43,859 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local199911252_0018
2015-02-11 00:08:43,875 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity199911252/.staging/job_local199911252_0018/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:43,876 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity199911252/.staging/job_local199911252_0018/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:43,920 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local199911252_0018/job_local199911252_0018.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:43,921 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local199911252_0018/job_local199911252_0018.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:43,922 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:08:43,922 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local199911252_0018
2015-02-11 00:08:43,922 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:08:43,922 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-02-11 00:08:43,923 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:08:43,926 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:08:43,926 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local199911252_0018_m_000000_0
2015-02-11 00:08:43,928 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:43,929 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt
2015-02-11 00:08:43,929 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@417e9329
2015-02-11 00:08:43,930 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:08:43,930 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:08:43,955 INFO mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:08:43,955 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:08:43,955 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:08:43,955 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:08:43,955 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:08:43,957 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:08:43,957 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:08:43,967 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:43,967 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:43,972 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-11 00:08:43,973 INFO mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:08:43,973 INFO mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:08:43,973 INFO mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 629; bufvoid = 104857600
2015-02-11 00:08:43,973 INFO mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2015-02-11 00:08:43,977 INFO mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:08:43,979 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local199911252_0018_m_000000_0 is done. And is in the process of committing
2015-02-11 00:08:43,980 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2015-02-11 00:08:43,981 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local199911252_0018_m_000000_0' done.
2015-02-11 00:08:43,981 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local199911252_0018_m_000000_0
2015-02-11 00:08:43,981 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:08:43,981 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:08:43,982 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local199911252_0018_r_000000_0
2015-02-11 00:08:43,983 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:43,983 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@162cc04e
2015-02-11 00:08:43,984 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:08:43,985 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local199911252_0018_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:08:43,989 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#18 about to shuffle output of map attempt_local199911252_0018_m_000000_0 decomp: 705 len: 709 to MEMORY
2015-02-11 00:08:43,990 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 705 bytes from map-output for attempt_local199911252_0018_m_000000_0
2015-02-11 00:08:43,990 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 705, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->705
2015-02-11 00:08:43,991 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:08:43,992 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:43,992 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:08:43,995 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:43,996 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 700 bytes
2015-02-11 00:08:43,999 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 705 bytes to disk to satisfy reduce memory limit
2015-02-11 00:08:43,999 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 709 bytes from disk
2015-02-11 00:08:43,999 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:08:44,000 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:44,000 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 700 bytes
2015-02-11 00:08:44,001 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:44,002 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:08:44,002 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:08:44,010 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:44,010 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_null_true_true"]
2015-02-11 00:08:44,025 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local199911252_0018_r_000000_0 is done. And is in the process of committing
2015-02-11 00:08:44,027 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:44,027 INFO mapred.Task (Task.java:commit(1162)) - Task attempt_local199911252_0018_r_000000_0 is allowed to commit now
2015-02-11 00:08:44,028 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local199911252_0018_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_null_true_true/_temporary/0/task_local199911252_0018_r_000000
2015-02-11 00:08:44,029 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:08:44,030 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local199911252_0018_r_000000_0' done.
2015-02-11 00:08:44,030 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local199911252_0018_r_000000_0
2015-02-11 00:08:44,030 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:08:44,054 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_null_true_true/_temporary
2015-02-11 00:08:44,084 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:44,102 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:08:44,102 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:08:44,109 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:08:44,111 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:08:44,112 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:08:44,116 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting
2015-02-11 00:08:44,116 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:44,117 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_false_false_true"]
2015-02-11 00:08:44,117 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] parallel execution is enabled: false
2015-02-11 00:08:44,117 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting jobs: 1
2015-02-11 00:08:44,117 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] allocating threads: 1
2015-02-11 00:08:44,118 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...ve/false_false_false_true
2015-02-11 00:08:44,118 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:44,119 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:44,144 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:44,164 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:08:44,180 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local195105393_0019
2015-02-11 00:08:44,195 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity195105393/.staging/job_local195105393_0019/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:44,195 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity195105393/.staging/job_local195105393_0019/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:44,240 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local195105393_0019/job_local195105393_0019.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:44,241 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local195105393_0019/job_local195105393_0019.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:44,242 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:08:44,242 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local195105393_0019
2015-02-11 00:08:44,243 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-02-11 00:08:44,243 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:08:44,244 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:08:44,248 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:08:44,248 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local195105393_0019_m_000000_0
2015-02-11 00:08:44,250 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:44,251 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt
2015-02-11 00:08:44,252 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@7c3422b5
2015-02-11 00:08:44,253 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:08:44,253 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:08:44,277 INFO mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:08:44,277 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:08:44,277 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:08:44,278 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:08:44,278 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:08:44,279 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:08:44,279 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:08:44,289 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:44,289 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:44,295 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-11 00:08:44,295 INFO mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:08:44,295 INFO mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:08:44,295 INFO mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 888; bufvoid = 104857600
2015-02-11 00:08:44,295 INFO mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2015-02-11 00:08:44,300 INFO mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:08:44,302 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local195105393_0019_m_000000_0 is done. And is in the process of committing
2015-02-11 00:08:44,304 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2015-02-11 00:08:44,304 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local195105393_0019_m_000000_0' done.
2015-02-11 00:08:44,305 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local195105393_0019_m_000000_0
2015-02-11 00:08:44,305 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:08:44,305 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:08:44,306 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local195105393_0019_r_000000_0
2015-02-11 00:08:44,307 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:44,307 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@13710065
2015-02-11 00:08:44,308 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:08:44,309 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local195105393_0019_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:08:44,310 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#19 about to shuffle output of map attempt_local195105393_0019_m_000000_0 decomp: 964 len: 968 to MEMORY
2015-02-11 00:08:44,311 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 964 bytes from map-output for attempt_local195105393_0019_m_000000_0
2015-02-11 00:08:44,311 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 964, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->964
2015-02-11 00:08:44,312 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:08:44,313 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:44,313 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:08:44,317 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:44,317 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2015-02-11 00:08:44,319 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 964 bytes to disk to satisfy reduce memory limit
2015-02-11 00:08:44,319 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 968 bytes from disk
2015-02-11 00:08:44,320 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:08:44,320 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:44,320 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2015-02-11 00:08:44,321 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:44,321 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:08:44,321 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:08:44,328 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:44,328 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_false_false_true"]
2015-02-11 00:08:44,343 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local195105393_0019_r_000000_0 is done. And is in the process of committing
2015-02-11 00:08:44,344 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:44,344 INFO mapred.Task (Task.java:commit(1162)) - Task attempt_local195105393_0019_r_000000_0 is allowed to commit now
2015-02-11 00:08:44,345 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local195105393_0019_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_false_false_true/_temporary/0/task_local195105393_0019_r_000000
2015-02-11 00:08:44,346 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:08:44,346 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local195105393_0019_r_000000_0' done.
2015-02-11 00:08:44,347 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local195105393_0019_r_000000_0
2015-02-11 00:08:44,347 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:08:44,365 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_false_false_true/_temporary
2015-02-11 00:08:44,393 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:44,412 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:08:44,412 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:08:44,419 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:08:44,421 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:08:44,422 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:08:44,426 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting
2015-02-11 00:08:44,427 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:44,427 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_false_false_true"]
2015-02-11 00:08:44,427 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] parallel execution is enabled: false
2015-02-11 00:08:44,428 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting jobs: 1
2015-02-11 00:08:44,428 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] allocating threads: 1
2015-02-11 00:08:44,429 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...ive/true_false_false_true
2015-02-11 00:08:44,430 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:44,431 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:44,455 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:44,476 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:08:44,492 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local973304014_0020
2015-02-11 00:08:44,508 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity973304014/.staging/job_local973304014_0020/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:44,510 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity973304014/.staging/job_local973304014_0020/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:44,555 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local973304014_0020/job_local973304014_0020.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:44,556 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local973304014_0020/job_local973304014_0020.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:44,557 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:08:44,557 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local973304014_0020
2015-02-11 00:08:44,558 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:08:44,558 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-02-11 00:08:44,558 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:08:44,561 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:08:44,561 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local973304014_0020_m_000000_0
2015-02-11 00:08:44,563 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:44,564 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt
2015-02-11 00:08:44,564 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@6e56103e
2015-02-11 00:08:44,565 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:08:44,565 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:08:44,589 INFO mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:08:44,590 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:08:44,590 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:08:44,590 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:08:44,590 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:08:44,592 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:08:44,592 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:08:44,600 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:44,600 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:44,606 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-11 00:08:44,606 INFO mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:08:44,606 INFO mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:08:44,606 INFO mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 888; bufvoid = 104857600
2015-02-11 00:08:44,606 INFO mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2015-02-11 00:08:44,611 INFO mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:08:44,614 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local973304014_0020_m_000000_0 is done. And is in the process of committing
2015-02-11 00:08:44,615 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2015-02-11 00:08:44,615 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local973304014_0020_m_000000_0' done.
2015-02-11 00:08:44,616 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local973304014_0020_m_000000_0
2015-02-11 00:08:44,616 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:08:44,616 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:08:44,617 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local973304014_0020_r_000000_0
2015-02-11 00:08:44,618 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:44,618 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@fe11c0e
2015-02-11 00:08:44,619 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:08:44,620 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local973304014_0020_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:08:44,622 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#20 about to shuffle output of map attempt_local973304014_0020_m_000000_0 decomp: 964 len: 968 to MEMORY
2015-02-11 00:08:44,623 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 964 bytes from map-output for attempt_local973304014_0020_m_000000_0
2015-02-11 00:08:44,623 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 964, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->964
2015-02-11 00:08:44,623 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:08:44,624 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:44,625 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:08:44,627 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:44,628 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2015-02-11 00:08:44,630 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 964 bytes to disk to satisfy reduce memory limit
2015-02-11 00:08:44,630 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 968 bytes from disk
2015-02-11 00:08:44,630 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:08:44,631 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:44,631 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2015-02-11 00:08:44,632 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:44,633 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:08:44,633 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:08:44,640 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:44,640 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_false_false_true"]
2015-02-11 00:08:44,655 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local973304014_0020_r_000000_0 is done. And is in the process of committing
2015-02-11 00:08:44,657 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:44,657 INFO mapred.Task (Task.java:commit(1162)) - Task attempt_local973304014_0020_r_000000_0 is allowed to commit now
2015-02-11 00:08:44,658 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local973304014_0020_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_false_false_true/_temporary/0/task_local973304014_0020_r_000000
2015-02-11 00:08:44,659 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:08:44,659 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local973304014_0020_r_000000_0' done.
2015-02-11 00:08:44,659 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local973304014_0020_r_000000_0
2015-02-11 00:08:44,659 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:08:44,677 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_false_false_true/_temporary
2015-02-11 00:08:44,704 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:44,722 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:08:44,723 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:08:44,730 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:08:44,732 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:08:44,732 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:08:44,737 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting
2015-02-11 00:08:44,737 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:44,738 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_true_false_true"]
2015-02-11 00:08:44,738 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] parallel execution is enabled: false
2015-02-11 00:08:44,738 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting jobs: 1
2015-02-11 00:08:44,738 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] allocating threads: 1
2015-02-11 00:08:44,739 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...sive/true_true_false_true
2015-02-11 00:08:44,739 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:44,742 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:44,768 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:44,788 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:08:44,804 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1205568284_0021
2015-02-11 00:08:44,818 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1205568284/.staging/job_local1205568284_0021/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:44,819 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1205568284/.staging/job_local1205568284_0021/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:44,861 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1205568284_0021/job_local1205568284_0021.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:44,863 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1205568284_0021/job_local1205568284_0021.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:44,863 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:08:44,864 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local1205568284_0021
2015-02-11 00:08:44,864 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:08:44,864 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-02-11 00:08:44,864 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:08:44,867 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:08:44,867 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1205568284_0021_m_000000_0
2015-02-11 00:08:44,869 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:44,870 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt
2015-02-11 00:08:44,870 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@57502283
2015-02-11 00:08:44,872 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:08:44,872 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:08:44,895 INFO mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:08:44,895 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:08:44,896 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:08:44,896 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:08:44,896 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:08:44,898 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:08:44,898 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:08:44,906 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:44,906 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:44,912 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-11 00:08:44,912 INFO mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:08:44,912 INFO mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:08:44,912 INFO mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 888; bufvoid = 104857600
2015-02-11 00:08:44,912 INFO mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2015-02-11 00:08:44,917 INFO mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:08:44,919 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local1205568284_0021_m_000000_0 is done. And is in the process of committing
2015-02-11 00:08:44,921 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2015-02-11 00:08:44,921 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1205568284_0021_m_000000_0' done.
2015-02-11 00:08:44,921 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1205568284_0021_m_000000_0
2015-02-11 00:08:44,921 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:08:44,922 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:08:44,922 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1205568284_0021_r_000000_0
2015-02-11 00:08:44,923 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:44,924 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@664bb5d8
2015-02-11 00:08:44,924 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:08:44,925 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1205568284_0021_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:08:44,927 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#21 about to shuffle output of map attempt_local1205568284_0021_m_000000_0 decomp: 964 len: 968 to MEMORY
2015-02-11 00:08:44,927 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 964 bytes from map-output for attempt_local1205568284_0021_m_000000_0
2015-02-11 00:08:44,927 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 964, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->964
2015-02-11 00:08:44,928 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:08:44,929 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:44,929 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:08:44,932 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:44,932 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2015-02-11 00:08:44,934 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 964 bytes to disk to satisfy reduce memory limit
2015-02-11 00:08:44,935 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 968 bytes from disk
2015-02-11 00:08:44,935 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:08:44,935 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:44,935 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2015-02-11 00:08:44,936 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:44,937 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:08:44,937 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:08:44,943 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:44,944 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_true_false_true"]
2015-02-11 00:08:44,959 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local1205568284_0021_r_000000_0 is done. And is in the process of committing
2015-02-11 00:08:44,961 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:44,961 INFO mapred.Task (Task.java:commit(1162)) - Task attempt_local1205568284_0021_r_000000_0 is allowed to commit now
2015-02-11 00:08:44,962 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1205568284_0021_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_true_false_true/_temporary/0/task_local1205568284_0021_r_000000
2015-02-11 00:08:44,963 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:08:44,963 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1205568284_0021_r_000000_0' done.
2015-02-11 00:08:44,963 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1205568284_0021_r_000000_0
2015-02-11 00:08:44,963 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:08:44,982 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_true_false_true/_temporary
2015-02-11 00:08:45,010 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:45,029 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:08:45,030 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:08:45,037 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:08:45,039 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:08:45,040 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:08:45,044 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting
2015-02-11 00:08:45,044 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:45,044 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_true_false_true"]
2015-02-11 00:08:45,045 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] parallel execution is enabled: false
2015-02-11 00:08:45,045 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting jobs: 1
2015-02-11 00:08:45,045 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] allocating threads: 1
2015-02-11 00:08:45,045 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...ive/false_true_false_true
2015-02-11 00:08:45,046 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:45,047 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:45,073 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:45,117 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:08:45,133 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1686103352_0022
2015-02-11 00:08:45,148 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1686103352/.staging/job_local1686103352_0022/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:45,149 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1686103352/.staging/job_local1686103352_0022/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:45,191 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1686103352_0022/job_local1686103352_0022.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:45,193 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1686103352_0022/job_local1686103352_0022.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:45,193 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:08:45,193 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local1686103352_0022
2015-02-11 00:08:45,194 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:08:45,194 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-02-11 00:08:45,194 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:08:45,197 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:08:45,197 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1686103352_0022_m_000000_0
2015-02-11 00:08:45,198 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:45,200 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt
2015-02-11 00:08:45,200 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@7869971
2015-02-11 00:08:45,201 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:08:45,201 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:08:45,226 INFO mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:08:45,226 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:08:45,226 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:08:45,226 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:08:45,226 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:08:45,228 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:08:45,228 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:08:45,237 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:45,238 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:45,244 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-11 00:08:45,244 INFO mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:08:45,244 INFO mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:08:45,244 INFO mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 888; bufvoid = 104857600
2015-02-11 00:08:45,244 INFO mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2015-02-11 00:08:45,250 INFO mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:08:45,252 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local1686103352_0022_m_000000_0 is done. And is in the process of committing
2015-02-11 00:08:45,254 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2015-02-11 00:08:45,254 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1686103352_0022_m_000000_0' done.
2015-02-11 00:08:45,254 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1686103352_0022_m_000000_0
2015-02-11 00:08:45,255 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:08:45,255 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:08:45,255 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1686103352_0022_r_000000_0
2015-02-11 00:08:45,257 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:45,257 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@39401e69
2015-02-11 00:08:45,259 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:08:45,260 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1686103352_0022_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:08:45,261 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#22 about to shuffle output of map attempt_local1686103352_0022_m_000000_0 decomp: 964 len: 968 to MEMORY
2015-02-11 00:08:45,262 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 964 bytes from map-output for attempt_local1686103352_0022_m_000000_0
2015-02-11 00:08:45,262 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 964, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->964
2015-02-11 00:08:45,263 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:08:45,264 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:45,264 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:08:45,270 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:45,270 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2015-02-11 00:08:45,273 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 964 bytes to disk to satisfy reduce memory limit
2015-02-11 00:08:45,273 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 968 bytes from disk
2015-02-11 00:08:45,274 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:08:45,274 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:45,275 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2015-02-11 00:08:45,275 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:45,276 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:08:45,276 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:08:45,283 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:45,283 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_true_false_true"]
2015-02-11 00:08:45,298 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local1686103352_0022_r_000000_0 is done. And is in the process of committing
2015-02-11 00:08:45,299 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:45,300 INFO mapred.Task (Task.java:commit(1162)) - Task attempt_local1686103352_0022_r_000000_0 is allowed to commit now
2015-02-11 00:08:45,300 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1686103352_0022_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_true_false_true/_temporary/0/task_local1686103352_0022_r_000000
2015-02-11 00:08:45,302 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:08:45,302 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1686103352_0022_r_000000_0' done.
2015-02-11 00:08:45,302 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1686103352_0022_r_000000_0
2015-02-11 00:08:45,302 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:08:45,323 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_true_false_true/_temporary
2015-02-11 00:08:45,350 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:45,368 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:08:45,369 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:08:45,375 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:08:45,377 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:08:45,378 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:08:45,382 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting
2015-02-11 00:08:45,383 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:45,383 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_false_true_true"]
2015-02-11 00:08:45,384 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] parallel execution is enabled: false
2015-02-11 00:08:45,384 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting jobs: 1
2015-02-11 00:08:45,385 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] allocating threads: 1
2015-02-11 00:08:45,386 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...ive/false_false_true_true
2015-02-11 00:08:45,387 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:45,389 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:45,413 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:45,433 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:08:45,449 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local879588650_0023
2015-02-11 00:08:45,464 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity879588650/.staging/job_local879588650_0023/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:45,465 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity879588650/.staging/job_local879588650_0023/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:45,507 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local879588650_0023/job_local879588650_0023.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:45,508 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local879588650_0023/job_local879588650_0023.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:45,509 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:08:45,509 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local879588650_0023
2015-02-11 00:08:45,509 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-02-11 00:08:45,510 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:08:45,510 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:08:45,513 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:08:45,513 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local879588650_0023_m_000000_0
2015-02-11 00:08:45,515 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:45,516 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt
2015-02-11 00:08:45,516 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@30317bdd
2015-02-11 00:08:45,517 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:08:45,517 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:08:45,543 INFO mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:08:45,543 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:08:45,543 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:08:45,543 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:08:45,543 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:08:45,544 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:08:45,545 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:08:45,555 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:45,555 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:45,561 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-11 00:08:45,562 INFO mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:08:45,562 INFO mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:08:45,562 INFO mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 888; bufvoid = 104857600
2015-02-11 00:08:45,563 INFO mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2015-02-11 00:08:45,568 INFO mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:08:45,570 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local879588650_0023_m_000000_0 is done. And is in the process of committing
2015-02-11 00:08:45,572 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2015-02-11 00:08:45,572 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local879588650_0023_m_000000_0' done.
2015-02-11 00:08:45,573 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local879588650_0023_m_000000_0
2015-02-11 00:08:45,573 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:08:45,574 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:08:45,574 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local879588650_0023_r_000000_0
2015-02-11 00:08:45,575 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:45,576 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@2e5797c0
2015-02-11 00:08:45,576 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:08:45,577 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local879588650_0023_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:08:45,579 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#23 about to shuffle output of map attempt_local879588650_0023_m_000000_0 decomp: 964 len: 968 to MEMORY
2015-02-11 00:08:45,579 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 964 bytes from map-output for attempt_local879588650_0023_m_000000_0
2015-02-11 00:08:45,579 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 964, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->964
2015-02-11 00:08:45,580 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:08:45,581 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:45,581 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:08:45,586 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:45,587 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2015-02-11 00:08:45,589 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 964 bytes to disk to satisfy reduce memory limit
2015-02-11 00:08:45,590 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 968 bytes from disk
2015-02-11 00:08:45,590 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:08:45,590 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:45,591 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2015-02-11 00:08:45,592 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:45,592 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:08:45,592 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:08:45,599 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:45,599 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_false_true_true"]
2015-02-11 00:08:45,614 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local879588650_0023_r_000000_0 is done. And is in the process of committing
2015-02-11 00:08:45,615 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:45,616 INFO mapred.Task (Task.java:commit(1162)) - Task attempt_local879588650_0023_r_000000_0 is allowed to commit now
2015-02-11 00:08:45,617 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local879588650_0023_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_false_true_true/_temporary/0/task_local879588650_0023_r_000000
2015-02-11 00:08:45,618 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:08:45,618 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local879588650_0023_r_000000_0' done.
2015-02-11 00:08:45,619 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local879588650_0023_r_000000_0
2015-02-11 00:08:45,619 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:08:45,639 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_false_true_true/_temporary
2015-02-11 00:08:45,666 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:45,685 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:08:45,685 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:08:45,691 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:08:45,693 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:08:45,694 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:08:45,698 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting
2015-02-11 00:08:45,699 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:45,699 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_false_true_true"]
2015-02-11 00:08:45,699 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] parallel execution is enabled: false
2015-02-11 00:08:45,700 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting jobs: 1
2015-02-11 00:08:45,700 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] allocating threads: 1
2015-02-11 00:08:45,701 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...sive/true_false_true_true
2015-02-11 00:08:45,701 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:45,702 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:45,728 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:45,747 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:08:45,763 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local976998578_0024
2015-02-11 00:08:45,778 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity976998578/.staging/job_local976998578_0024/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:45,779 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity976998578/.staging/job_local976998578_0024/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:45,822 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local976998578_0024/job_local976998578_0024.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:45,823 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local976998578_0024/job_local976998578_0024.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:45,824 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:08:45,824 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local976998578_0024
2015-02-11 00:08:45,824 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:08:45,824 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-02-11 00:08:45,825 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:08:45,827 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:08:45,828 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local976998578_0024_m_000000_0
2015-02-11 00:08:45,829 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:45,831 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt
2015-02-11 00:08:45,831 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@2aa49512
2015-02-11 00:08:45,832 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:08:45,832 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:08:45,856 INFO mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:08:45,856 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:08:45,856 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:08:45,856 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:08:45,856 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:08:45,858 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:08:45,858 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:08:45,867 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:45,867 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:45,873 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-11 00:08:45,873 INFO mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:08:45,873 INFO mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:08:45,873 INFO mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 888; bufvoid = 104857600
2015-02-11 00:08:45,873 INFO mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2015-02-11 00:08:45,879 INFO mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:08:45,881 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local976998578_0024_m_000000_0 is done. And is in the process of committing
2015-02-11 00:08:45,882 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2015-02-11 00:08:45,883 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local976998578_0024_m_000000_0' done.
2015-02-11 00:08:45,883 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local976998578_0024_m_000000_0
2015-02-11 00:08:45,883 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:08:45,883 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:08:45,884 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local976998578_0024_r_000000_0
2015-02-11 00:08:45,885 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:45,885 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@4ce868c9
2015-02-11 00:08:45,886 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:08:45,887 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local976998578_0024_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:08:45,888 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#24 about to shuffle output of map attempt_local976998578_0024_m_000000_0 decomp: 964 len: 968 to MEMORY
2015-02-11 00:08:45,889 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 964 bytes from map-output for attempt_local976998578_0024_m_000000_0
2015-02-11 00:08:45,889 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 964, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->964
2015-02-11 00:08:45,890 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:08:45,891 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:45,891 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:08:45,895 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:45,895 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2015-02-11 00:08:45,898 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 964 bytes to disk to satisfy reduce memory limit
2015-02-11 00:08:45,898 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 968 bytes from disk
2015-02-11 00:08:45,899 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:08:45,899 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:45,900 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2015-02-11 00:08:45,900 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:45,901 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:08:45,902 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:08:45,909 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:45,910 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_false_true_true"]
2015-02-11 00:08:45,924 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local976998578_0024_r_000000_0 is done. And is in the process of committing
2015-02-11 00:08:45,926 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:45,926 INFO mapred.Task (Task.java:commit(1162)) - Task attempt_local976998578_0024_r_000000_0 is allowed to commit now
2015-02-11 00:08:45,927 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local976998578_0024_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_false_true_true/_temporary/0/task_local976998578_0024_r_000000
2015-02-11 00:08:45,928 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:08:45,928 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local976998578_0024_r_000000_0' done.
2015-02-11 00:08:45,928 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local976998578_0024_r_000000_0
2015-02-11 00:08:45,929 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:08:45,944 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_false_true_true/_temporary
2015-02-11 00:08:45,972 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:45,993 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:08:45,993 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:08:46,000 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:08:46,002 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:08:46,003 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:08:46,008 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting
2015-02-11 00:08:46,008 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:46,008 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_true_true_true"]
2015-02-11 00:08:46,008 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] parallel execution is enabled: false
2015-02-11 00:08:46,008 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting jobs: 1
2015-02-11 00:08:46,008 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] allocating threads: 1
2015-02-11 00:08:46,009 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...nsive/true_true_true_true
2015-02-11 00:08:46,010 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:46,011 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:46,035 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:46,054 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:08:46,070 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local53737030_0025
2015-02-11 00:08:46,084 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity53737030/.staging/job_local53737030_0025/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:46,085 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity53737030/.staging/job_local53737030_0025/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:46,127 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local53737030_0025/job_local53737030_0025.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:46,128 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local53737030_0025/job_local53737030_0025.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:46,129 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:08:46,129 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local53737030_0025
2015-02-11 00:08:46,129 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:08:46,129 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-02-11 00:08:46,130 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:08:46,133 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:08:46,133 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local53737030_0025_m_000000_0
2015-02-11 00:08:46,134 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:46,136 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt
2015-02-11 00:08:46,136 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@2470b02c
2015-02-11 00:08:46,137 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:08:46,137 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:08:46,162 INFO mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:08:46,162 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:08:46,162 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:08:46,162 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:08:46,162 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:08:46,164 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:08:46,165 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:08:46,175 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:46,176 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:46,182 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-11 00:08:46,183 INFO mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:08:46,183 INFO mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:08:46,183 INFO mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 888; bufvoid = 104857600
2015-02-11 00:08:46,184 INFO mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2015-02-11 00:08:46,189 INFO mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:08:46,191 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local53737030_0025_m_000000_0 is done. And is in the process of committing
2015-02-11 00:08:46,193 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2015-02-11 00:08:46,194 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local53737030_0025_m_000000_0' done.
2015-02-11 00:08:46,194 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local53737030_0025_m_000000_0
2015-02-11 00:08:46,194 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:08:46,195 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:08:46,195 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local53737030_0025_r_000000_0
2015-02-11 00:08:46,197 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:46,197 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@4ba7da17
2015-02-11 00:08:46,198 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:08:46,198 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local53737030_0025_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:08:46,200 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#25 about to shuffle output of map attempt_local53737030_0025_m_000000_0 decomp: 964 len: 968 to MEMORY
2015-02-11 00:08:46,201 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 964 bytes from map-output for attempt_local53737030_0025_m_000000_0
2015-02-11 00:08:46,201 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 964, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->964
2015-02-11 00:08:46,202 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:08:46,203 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:46,203 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:08:46,206 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:46,207 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2015-02-11 00:08:46,209 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 964 bytes to disk to satisfy reduce memory limit
2015-02-11 00:08:46,209 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 968 bytes from disk
2015-02-11 00:08:46,209 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:08:46,209 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:46,210 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2015-02-11 00:08:46,210 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:46,211 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:08:46,211 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:08:46,217 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:46,217 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_true_true_true"]
2015-02-11 00:08:46,231 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local53737030_0025_r_000000_0 is done. And is in the process of committing
2015-02-11 00:08:46,233 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:46,233 INFO mapred.Task (Task.java:commit(1162)) - Task attempt_local53737030_0025_r_000000_0 is allowed to commit now
2015-02-11 00:08:46,234 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local53737030_0025_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_true_true_true/_temporary/0/task_local53737030_0025_r_000000
2015-02-11 00:08:46,235 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:08:46,235 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local53737030_0025_r_000000_0' done.
2015-02-11 00:08:46,236 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local53737030_0025_r_000000_0
2015-02-11 00:08:46,236 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:08:46,258 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/true_true_true_true/_temporary
2015-02-11 00:08:46,286 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:46,306 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:08:46,307 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:08:46,314 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:08:46,316 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:08:46,316 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:08:46,321 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting
2015-02-11 00:08:46,322 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] source: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:46,322 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] sink: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_true_true_true"]
2015-02-11 00:08:46,322 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] parallel execution is enabled: false
2015-02-11 00:08:46,322 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] starting jobs: 1
2015-02-11 00:08:46,322 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [comprehensivesort] allocating threads: 1
2015-02-11 00:08:46,323 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] starting step: (1/1) ...sive/false_true_true_true
2015-02-11 00:08:46,323 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:46,324 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:08:46,348 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:46,367 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:08:46,384 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1822858470_0026
2015-02-11 00:08:46,399 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1822858470/.staging/job_local1822858470_0026/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:46,400 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1822858470/.staging/job_local1822858470_0026/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:46,443 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1822858470_0026/job_local1822858470_0026.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-11 00:08:46,445 WARN conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1822858470_0026/job_local1822858470_0026.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-11 00:08:46,445 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:08:46,446 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:08:46,446 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:08:46,446 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] submitted hadoop job: job_local1822858470_0026
2015-02-11 00:08:46,447 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [comprehensivesort] tracking url: http://localhost:8080/
2015-02-11 00:08:46,449 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:08:46,449 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1822858470_0026_m_000000_0
2015-02-11 00:08:46,450 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:46,452 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt
2015-02-11 00:08:46,452 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@55f5b5fd
2015-02-11 00:08:46,453 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:08:46,453 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:08:46,476 INFO mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:08:46,477 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:08:46,477 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:08:46,477 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:08:46,477 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:08:46,479 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:08:46,479 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:08:46,485 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-11 00:08:46,485 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:46,491 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-11 00:08:46,491 INFO mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:08:46,491 INFO mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:08:46,491 INFO mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 888; bufvoid = 104857600
2015-02-11 00:08:46,492 INFO mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214252(104857008); length = 145/6553600
2015-02-11 00:08:46,497 INFO mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:08:46,499 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local1822858470_0026_m_000000_0 is done. And is in the process of committing
2015-02-11 00:08:46,501 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2015-02-11 00:08:46,501 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1822858470_0026_m_000000_0' done.
2015-02-11 00:08:46,501 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1822858470_0026_m_000000_0
2015-02-11 00:08:46,501 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:08:46,502 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:08:46,502 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1822858470_0026_r_000000_0
2015-02-11 00:08:46,503 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:08:46,503 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@585bd18b
2015-02-11 00:08:46,504 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:08:46,505 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1822858470_0026_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:08:46,506 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#26 about to shuffle output of map attempt_local1822858470_0026_m_000000_0 decomp: 964 len: 968 to MEMORY
2015-02-11 00:08:46,507 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 964 bytes from map-output for attempt_local1822858470_0026_m_000000_0
2015-02-11 00:08:46,507 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 964, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->964
2015-02-11 00:08:46,508 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:08:46,509 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:46,509 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:08:46,516 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:46,516 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2015-02-11 00:08:46,518 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 964 bytes to disk to satisfy reduce memory limit
2015-02-11 00:08:46,518 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 968 bytes from disk
2015-02-11 00:08:46,518 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:08:46,518 INFO mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:08:46,519 INFO mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 952 bytes
2015-02-11 00:08:46,519 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:46,520 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:08:46,520 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:08:46,525 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(comprehensivesort)[by:[{1}:'num']]
2015-02-11 00:08:46,525 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_true_true_true"]
2015-02-11 00:08:46,540 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local1822858470_0026_r_000000_0 is done. And is in the process of committing
2015-02-11 00:08:46,541 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:08:46,541 INFO mapred.Task (Task.java:commit(1162)) - Task attempt_local1822858470_0026_r_000000_0 is allowed to commit now
2015-02-11 00:08:46,542 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1822858470_0026_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_true_true_true/_temporary/0/task_local1822858470_0026_r_000000
2015-02-11 00:08:46,543 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:08:46,543 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1822858470_0026_r_000000_0' done.
2015-02-11 00:08:46,543 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1822858470_0026_r_000000_0
2015-02-11 00:08:46,543 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:08:46,563 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/sortedvaluesplatform/comprehensive/false_true_true_true/_temporary
2015-02-11 00:08:46,592 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:08:46,595 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/false_true_true_true
2015-02-11 00:08:46,595 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/true_true_true_true
2015-02-11 00:08:46,596 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/true_false_false_true
2015-02-11 00:08:46,596 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/false_true_false_true
2015-02-11 00:08:46,596 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/true_true_true_false
2015-02-11 00:08:46,596 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/true_true_false_true
2015-02-11 00:08:46,597 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/true_null_true_true
2015-02-11 00:08:46,597 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/false_null_false_true
2015-02-11 00:08:46,597 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/true_false_true_false
2015-02-11 00:08:46,597 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/true_false_false_false
2015-02-11 00:08:46,597 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/false_false_true_false
2015-02-11 00:08:46,598 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/false_null_false_false
2015-02-11 00:08:46,598 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/false_false_false_true
2015-02-11 00:08:46,598 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/true_null_false_true
2015-02-11 00:08:46,598 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/true_null_false_false
2015-02-11 00:08:46,599 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/false_null_true_true
2015-02-11 00:08:46,599 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/false_null_true_false
2015-02-11 00:08:46,599 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/true_null_true_false
2015-02-11 00:08:46,599 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/false_false_true_true
2015-02-11 00:08:46,599 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/true_true_false_false
2015-02-11 00:08:46,600 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/true_false_true_true
2015-02-11 00:08:46,600 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/false_true_true_false
2015-02-11 00:08:46,600 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/false_true_false_false
2015-02-11 00:08:46,600 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/sortedvaluesplatform/comprehensive/false_false_false_false