Class cascading.pipe.assembly.AssemblyHelpersPlatformTest

33

tests

0

failures

12.795s

duration

100%

successful

Tests

Test Duration Result
testAverageBy 0.183s passed
testAverageByNull 0.272s passed
testAverageMerge 0.660s passed
testCoerce 0.082s passed
testCoerceFields 0.128s passed
testCount 0.319s passed
testCountAll 0.198s passed
testCountCount 0.965s passed
testCountMerge 0.569s passed
testCountNullNotNull 0.160s passed
testDiscardNarrow 0.159s passed
testFirstBy 0.313s passed
testFirstByWithoutComparator 0.132s passed
testMaxBy 0.322s passed
testMaxByNullSafety 0.292s passed
testMaxByString 0.559s passed
testMinBy 0.293s passed
testMinByNullSafety 0.359s passed
testMinByString 0.483s passed
testParallelAggregates 0.305s passed
testParallelAggregatesMerge 2.324s passed
testParallelAggregatesPriorMerge 0.401s passed
testRenameAll 0.159s passed
testRenameNamed 0.093s passed
testRenameNarrow 0.078s passed
testRetainNarrow 0.093s passed
testSameSourceMerge 0.589s passed
testSameSourceMergeThreeWay 0.760s passed
testSumBy 0.465s passed
testSumByNulls 0.444s passed
testSumMerge 0.312s passed
testUnique 0.123s passed
testUniqueMerge 0.201s passed

Standard output

2015-02-10 16:16:03,265 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(187)) - found 1 test platforms from classpath
2015-02-10 16:16:03,312 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(237)) - installing platform: hadoop
2015-02-10 16:16:03,313 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(238)) - running test: cascading.pipe.assembly.AssemblyHelpersPlatformTest
2015-02-10 16:16:03,355 INFO  hadoop.HadoopPlatform (HadoopPlatform.java:setUp(112)) - not using cluster
2015-02-10 16:16:04,051 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:04,054 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:04,067 INFO  property.AppProps (AppProps.java:getAppID(169)) - using app.id: 46316047E0754E8698EF7825B113A2FE
2015-02-10 16:16:04,355 INFO  util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 2.6.3
2015-02-10 16:16:04,359 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [name] starting
2015-02-10 16:16:04,360 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [name]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt"]
2015-02-10 16:16:04,361 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [name]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:04,362 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [name]  sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/multimerge+false"]
2015-02-10 16:16:04,363 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [name]  parallel execution is enabled: false
2015-02-10 16:16:04,364 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [name]  starting jobs: 1
2015-02-10 16:16:04,364 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [name]  allocating threads: 1
2015-02-10 16:16:04,366 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [name] starting step: (1/1) ...platform/multimerge+false
2015-02-10 16:16:04,420 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(52)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2015-02-10 16:16:04,496 WARN  snappy.LoadSnappy (LoadSnappy.java:<clinit>(46)) - Snappy native library not loaded
2015-02-10 16:16:04,500 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:04,510 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:04,752 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [name] submitted hadoop job: job_local_0001
2015-02-10 16:16:04,754 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [name] tracking url: http://localhost:8080/
2015-02-10 16:16:04,826 INFO  util.ProcessTree (ProcessTree.java:isSetsidSupported(63)) - setsid exited with exit code 0
2015-02-10 16:16:04,835 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@1f2be27
2015-02-10 16:16:04,843 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:04,851 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:04,860 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:05,021 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:05,021 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:05,050 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:05,051 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:05,124 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:05,125 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2015-02-10 16:16:05,131 INFO  assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:05,145 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:05,146 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 79, total: 197, max: 672
2015-02-10 16:16:05,147 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 29% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:05,149 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:05,150 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 79, total: 197, max: 672
2015-02-10 16:16:05,151 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 29% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:05,152 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:05,153 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 79, total: 197, max: 672
2015-02-10 16:16:05,154 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 29% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:05,155 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:05,156 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 79, total: 197, max: 672
2015-02-10 16:16:05,157 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 29% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:05,158 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:05,170 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:05,173 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0001_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:05,178 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:05,179 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0001_m_000000_0' done.
2015-02-10 16:16:05,183 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@4e3c35fd
2015-02-10 16:16:05,185 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt
2015-02-10 16:16:05,188 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:05,189 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:05,328 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:05,329 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:05,333 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:05,334 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:05,361 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt"]
2015-02-10 16:16:05,362 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2015-02-10 16:16:05,365 INFO  assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:05,476 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:05,477 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 91, total: 292, max: 672
2015-02-10 16:16:05,477 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 43% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:05,480 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:05,480 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 91, total: 292, max: 672
2015-02-10 16:16:05,481 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 43% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:05,483 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:05,484 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 91, total: 292, max: 672
2015-02-10 16:16:05,485 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 43% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:05,486 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:05,487 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 90, total: 292, max: 672
2015-02-10 16:16:05,488 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 43% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:05,489 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:05,494 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:05,497 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0001_m_000001_0 is done. And is in the process of commiting
2015-02-10 16:16:05,499 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt:0+51
2015-02-10 16:16:05,501 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0001_m_000001_0' done.
2015-02-10 16:16:05,518 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@63f9f0f2
2015-02-10 16:16:05,518 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:05,527 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 2 sorted segments
2015-02-10 16:16:05,535 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 2 segments left of total size: 472 bytes
2015-02-10 16:16:05,536 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:05,540 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:05,541 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:05,568 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2015-02-10 16:16:05,569 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/multimerge+false"]
2015-02-10 16:16:05,596 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0001_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:05,598 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:05,599 INFO  mapred.Task (Task.java:commit(1011)) - Task attempt_local_0001_r_000000_0 is allowed to commit now
2015-02-10 16:16:05,604 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0001_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/multimerge+false
2015-02-10 16:16:05,605 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:05,606 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0001_r_000000_0' done.
2015-02-10 16:16:05,624 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/multimerge+false/_temporary
2015-02-10 16:16:05,648 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:05,673 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:05,676 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/multimerge+false
2015-02-10 16:16:05,707 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:05,708 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:05,743 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [max] starting
2015-02-10 16:16:05,744 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [max]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:05,745 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [max]  sink: Hfs["TextDelimited[['num', 'min']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/minbystring"]
2015-02-10 16:16:05,745 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [max]  parallel execution is enabled: false
2015-02-10 16:16:05,746 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [max]  starting jobs: 1
2015-02-10 16:16:05,747 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [max]  allocating threads: 1
2015-02-10 16:16:05,748 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [max] starting step: (1/1) ...lpersplatform/minbystring
2015-02-10 16:16:05,764 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:05,863 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [max] submitted hadoop job: job_local_0002
2015-02-10 16:16:05,863 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [max] tracking url: http://localhost:8080/
2015-02-10 16:16:05,867 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@65cb048e
2015-02-10 16:16:05,869 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:05,871 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:05,872 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:06,025 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:06,025 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:06,028 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:06,028 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:06,042 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:06,042 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(max)[by:[{1}:'num']]
2015-02-10 16:16:06,043 INFO  assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:06,045 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:06,045 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 70, total: 387, max: 672
2015-02-10 16:16:06,045 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 57% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:06,046 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:06,047 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 70, total: 387, max: 672
2015-02-10 16:16:06,047 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 57% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:06,048 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:06,051 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:06,054 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0002_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:06,055 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:06,056 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0002_m_000000_0' done.
2015-02-10 16:16:06,061 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@20edbca8
2015-02-10 16:16:06,062 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:06,063 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:06,064 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 87 bytes
2015-02-10 16:16:06,064 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:06,065 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:06,066 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:06,078 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(max)[by:[{1}:'num']]
2015-02-10 16:16:06,079 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['num', 'min']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/minbystring"]
2015-02-10 16:16:06,087 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0002_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:06,088 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:06,089 INFO  mapred.Task (Task.java:commit(1011)) - Task attempt_local_0002_r_000000_0 is allowed to commit now
2015-02-10 16:16:06,093 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0002_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/minbystring
2015-02-10 16:16:06,094 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:06,095 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0002_r_000000_0' done.
2015-02-10 16:16:06,106 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/minbystring/_temporary
2015-02-10 16:16:06,129 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:06,158 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:06,161 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/minbystring
2015-02-10 16:16:06,191 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:06,192 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:06,233 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [average-lhs+average-rhs] starting
2015-02-10 16:16:06,234 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [average-lhs+average-rhs]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt"]
2015-02-10 16:16:06,235 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [average-lhs+average-rhs]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:06,236 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [average-lhs+average-rhs]  sink: Hfs["TextDelimited[['char', 'average']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/mergeaverage"]
2015-02-10 16:16:06,236 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [average-lhs+average-rhs]  parallel execution is enabled: false
2015-02-10 16:16:06,237 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [average-lhs+average-rhs]  starting jobs: 1
2015-02-10 16:16:06,237 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [average-lhs+average-rhs]  allocating threads: 1
2015-02-10 16:16:06,239 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [average-lhs+average-rhs] starting step: (1/1) ...persplatform/mergeaverage
2015-02-10 16:16:06,254 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:06,256 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:06,309 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [average-lhs+average-rhs] submitted hadoop job: job_local_0003
2015-02-10 16:16:06,310 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [average-lhs+average-rhs] tracking url: http://localhost:8080/
2015-02-10 16:16:06,314 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@5694fe42
2015-02-10 16:16:06,316 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:06,318 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:06,318 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:06,467 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:06,468 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:06,469 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:06,469 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:06,485 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:06,486 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(average-lhs+average-rhs)[by: average-lhs:[{1}:'char'] average-rhs:[{1}:'char']]
2015-02-10 16:16:06,486 INFO  assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:06,488 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:06,488 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 79, total: 482, max: 672
2015-02-10 16:16:06,489 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:06,490 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:06,490 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 79, total: 482, max: 672
2015-02-10 16:16:06,490 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:06,491 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:06,492 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 79, total: 482, max: 672
2015-02-10 16:16:06,492 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:06,493 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:06,493 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 79, total: 482, max: 672
2015-02-10 16:16:06,493 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:06,494 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:06,497 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:06,500 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0003_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:06,501 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:06,502 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0003_m_000000_0' done.
2015-02-10 16:16:06,504 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@57c501f7
2015-02-10 16:16:06,507 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt
2015-02-10 16:16:06,508 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:06,509 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:06,658 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:06,658 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:06,660 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:06,660 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:06,675 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt"]
2015-02-10 16:16:06,676 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(average-lhs+average-rhs)[by: average-lhs:[{1}:'char'] average-rhs:[{1}:'char']]
2015-02-10 16:16:06,676 INFO  assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:06,681 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:06,681 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 30, total: 535, max: 672
2015-02-10 16:16:06,681 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 79% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:06,683 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:06,683 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 29, total: 535, max: 672
2015-02-10 16:16:06,683 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 79% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:06,684 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:06,685 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 29, total: 535, max: 672
2015-02-10 16:16:06,685 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 79% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:06,686 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:06,686 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 29, total: 535, max: 672
2015-02-10 16:16:06,687 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 79% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:06,687 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:06,713 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:06,715 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0003_m_000001_0 is done. And is in the process of commiting
2015-02-10 16:16:06,716 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt:0+51
2015-02-10 16:16:06,717 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0003_m_000001_0' done.
2015-02-10 16:16:06,726 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@576eeb9
2015-02-10 16:16:06,727 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:06,729 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 2 sorted segments
2015-02-10 16:16:06,729 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 2 segments left of total size: 400 bytes
2015-02-10 16:16:06,730 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:06,731 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:06,731 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:06,744 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(average-lhs+average-rhs)[by: average-lhs:[{1}:'char'] average-rhs:[{1}:'char']]
2015-02-10 16:16:06,745 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'average']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/mergeaverage"]
2015-02-10 16:16:06,754 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0003_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:06,754 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:06,756 INFO  mapred.Task (Task.java:commit(1011)) - Task attempt_local_0003_r_000000_0 is allowed to commit now
2015-02-10 16:16:06,759 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0003_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/mergeaverage
2015-02-10 16:16:06,760 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:06,761 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0003_r_000000_0' done.
2015-02-10 16:16:06,776 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/mergeaverage/_temporary
2015-02-10 16:16:06,789 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:06,820 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:06,822 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/mergeaverage
2015-02-10 16:16:06,841 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:06,842 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:06,866 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [shape] starting
2015-02-10 16:16:06,867 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [shape]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt"]
2015-02-10 16:16:06,868 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [shape]  sink: Hfs["TextLine[['line']->['item', 'element']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/renameall"]
2015-02-10 16:16:06,868 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [shape]  parallel execution is enabled: false
2015-02-10 16:16:06,868 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [shape]  starting jobs: 1
2015-02-10 16:16:06,868 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [shape]  allocating threads: 1
2015-02-10 16:16:06,869 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] starting step: (1/1) ...helpersplatform/renameall
2015-02-10 16:16:06,884 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:06,925 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] submitted hadoop job: job_local_0004
2015-02-10 16:16:06,926 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] tracking url: http://localhost:8080/
2015-02-10 16:16:06,930 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@14cef147
2015-02-10 16:16:06,932 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt
2015-02-10 16:16:06,933 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 0
2015-02-10 16:16:06,939 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:06,939 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:06,947 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt"]
2015-02-10 16:16:06,947 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['line']->['item', 'element']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/renameall"]
2015-02-10 16:16:06,951 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0004_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:06,951 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:06,952 INFO  mapred.Task (Task.java:commit(1011)) - Task attempt_local_0004_m_000000_0 is allowed to commit now
2015-02-10 16:16:06,956 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0004_m_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/renameall
2015-02-10 16:16:06,956 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt:0+19
2015-02-10 16:16:06,957 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0004_m_000000_0' done.
2015-02-10 16:16:06,968 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/renameall/_temporary
2015-02-10 16:16:06,980 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:06,982 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/renameall
2015-02-10 16:16:07,001 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:07,002 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:07,053 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [count] starting
2015-02-10 16:16:07,054 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [count]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:07,054 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [count]  sink: Hfs["TextDelimited[['count', 'count2']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/countcount"]
2015-02-10 16:16:07,054 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [count]  parallel execution is enabled: false
2015-02-10 16:16:07,055 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [count]  starting jobs: 2
2015-02-10 16:16:07,055 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [count]  allocating threads: 1
2015-02-10 16:16:07,056 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] starting step: (1/2)
2015-02-10 16:16:07,131 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:07,175 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] submitted hadoop job: job_local_0005
2015-02-10 16:16:07,177 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] tracking url: http://localhost:8080/
2015-02-10 16:16:07,179 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@7991ba7
2015-02-10 16:16:07,181 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:07,182 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:07,183 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:07,543 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:07,546 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:07,548 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:07,548 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:07,562 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:07,563 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(count)[by:[{1}:'char']]
2015-02-10 16:16:07,564 INFO  assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:07,566 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:07,567 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 77, total: 181, max: 672
2015-02-10 16:16:07,568 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 26% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:07,569 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:07,570 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 77, total: 181, max: 672
2015-02-10 16:16:07,570 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 26% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:07,571 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:07,572 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 77, total: 181, max: 672
2015-02-10 16:16:07,573 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 26% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:07,574 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:07,574 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 77, total: 181, max: 672
2015-02-10 16:16:07,575 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 26% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:07,576 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:07,579 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:07,582 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0005_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:07,584 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:07,585 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0005_m_000000_0' done.
2015-02-10 16:16:07,590 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@60396c7
2015-02-10 16:16:07,590 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:07,593 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:07,594 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 119 bytes
2015-02-10 16:16:07,594 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:07,596 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:07,596 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:07,607 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(count)[by:[{1}:'char']]
2015-02-10 16:16:07,608 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: TempHfs["SequenceFile[['count', 'count2']]"][8010798447/count/]
2015-02-10 16:16:07,620 INFO  assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:07,622 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:07,623 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 75, total: 181, max: 672
2015-02-10 16:16:07,624 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 26% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:07,626 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0005_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:07,627 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:07,628 INFO  mapred.Task (Task.java:commit(1011)) - Task attempt_local_0005_r_000000_0 is allowed to commit now
2015-02-10 16:16:07,631 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0005_r_000000_0' to file:/tmp/hadoop-teamcity/8010798447_count_0C91A42083404A0EA893942D828E4592
2015-02-10 16:16:07,632 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:07,633 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0005_r_000000_0' done.
2015-02-10 16:16:07,644 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] starting step: (2/2) ...elpersplatform/countcount
2015-02-10 16:16:07,658 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:07,697 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] submitted hadoop job: job_local_0006
2015-02-10 16:16:07,698 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] tracking url: http://localhost:8080/
2015-02-10 16:16:07,701 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@70b125bd
2015-02-10 16:16:07,703 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/8010798447_count_0C91A42083404A0EA893942D828E4592/part-00000
2015-02-10 16:16:07,710 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:07,710 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:07,850 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:07,851 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:07,853 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:07,853 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:07,865 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: TempHfs["SequenceFile[['count', 'count2']]"][8010798447/count/]
2015-02-10 16:16:07,865 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(count)[by:[{1}:'count']]
2015-02-10 16:16:07,867 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:07,869 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:07,871 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0006_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:07,873 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/tmp/hadoop-teamcity/8010798447_count_0C91A42083404A0EA893942D828E4592/part-00000:0+112
2015-02-10 16:16:07,874 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0006_m_000000_0' done.
2015-02-10 16:16:07,878 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@762d4c7e
2015-02-10 16:16:07,878 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:07,879 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:07,880 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 29 bytes
2015-02-10 16:16:07,880 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:07,881 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:07,881 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:07,892 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(count)[by:[{1}:'count']]
2015-02-10 16:16:07,893 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['count', 'count2']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/countcount"]
2015-02-10 16:16:07,901 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0006_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:07,902 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:07,903 INFO  mapred.Task (Task.java:commit(1011)) - Task attempt_local_0006_r_000000_0 is allowed to commit now
2015-02-10 16:16:07,906 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0006_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/countcount
2015-02-10 16:16:07,906 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:07,907 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0006_r_000000_0' done.
2015-02-10 16:16:07,922 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/countcount/_temporary
2015-02-10 16:16:07,934 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:07,946 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:07,948 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/countcount
2015-02-10 16:16:07,967 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:07,968 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:08,000 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [count-lhs+count-rhs] starting
2015-02-10 16:16:08,009 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [count-lhs+count-rhs]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt"]
2015-02-10 16:16:08,011 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [count-lhs+count-rhs]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:08,012 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [count-lhs+count-rhs]  sink: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/mergecount"]
2015-02-10 16:16:08,013 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [count-lhs+count-rhs]  parallel execution is enabled: false
2015-02-10 16:16:08,013 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [count-lhs+count-rhs]  starting jobs: 1
2015-02-10 16:16:08,013 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [count-lhs+count-rhs]  allocating threads: 1
2015-02-10 16:16:08,014 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs+count-rhs] starting step: (1/1) ...elpersplatform/mergecount
2015-02-10 16:16:08,030 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:08,032 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:08,067 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs+count-rhs] submitted hadoop job: job_local_0007
2015-02-10 16:16:08,067 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs+count-rhs] tracking url: http://localhost:8080/
2015-02-10 16:16:08,072 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@239b0124
2015-02-10 16:16:08,073 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:08,075 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:08,075 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:08,228 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:08,228 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:08,230 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:08,230 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:08,244 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:08,244 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(count-lhs+count-rhs)[by: count-lhs:[{1}:'char'] count-rhs:[{1}:'char']]
2015-02-10 16:16:08,244 INFO  assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:08,246 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:08,246 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 91, total: 395, max: 672
2015-02-10 16:16:08,246 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 58% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:08,247 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:08,248 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 90, total: 395, max: 672
2015-02-10 16:16:08,248 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 58% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:08,249 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:08,249 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 90, total: 395, max: 672
2015-02-10 16:16:08,249 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 58% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:08,250 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:08,250 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 90, total: 395, max: 672
2015-02-10 16:16:08,250 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 58% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:08,251 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:08,254 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:08,255 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0007_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:08,257 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:08,258 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0007_m_000000_0' done.
2015-02-10 16:16:08,260 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@3f610944
2015-02-10 16:16:08,261 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt
2015-02-10 16:16:08,263 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:08,263 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:08,414 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:08,414 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:08,415 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:08,416 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:08,429 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt"]
2015-02-10 16:16:08,429 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(count-lhs+count-rhs)[by: count-lhs:[{1}:'char'] count-rhs:[{1}:'char']]
2015-02-10 16:16:08,430 INFO  assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:08,434 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:08,434 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 84, total: 490, max: 672
2015-02-10 16:16:08,434 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 72% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:08,436 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:08,436 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 83, total: 490, max: 672
2015-02-10 16:16:08,436 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 72% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:08,437 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:08,437 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 83, total: 490, max: 672
2015-02-10 16:16:08,437 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 72% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:08,438 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:08,438 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 83, total: 490, max: 672
2015-02-10 16:16:08,438 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 72% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:08,439 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:08,442 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:08,443 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0007_m_000001_0 is done. And is in the process of commiting
2015-02-10 16:16:08,445 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt:0+51
2015-02-10 16:16:08,446 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0007_m_000001_0' done.
2015-02-10 16:16:08,453 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@75db5427
2015-02-10 16:16:08,453 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:08,455 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 2 sorted segments
2015-02-10 16:16:08,456 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 2 segments left of total size: 238 bytes
2015-02-10 16:16:08,456 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:08,458 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:08,458 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:08,471 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(count-lhs+count-rhs)[by: count-lhs:[{1}:'char'] count-rhs:[{1}:'char']]
2015-02-10 16:16:08,471 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/mergecount"]
2015-02-10 16:16:08,479 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0007_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:08,480 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:08,481 INFO  mapred.Task (Task.java:commit(1011)) - Task attempt_local_0007_r_000000_0 is allowed to commit now
2015-02-10 16:16:08,484 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0007_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/mergecount
2015-02-10 16:16:08,484 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:08,485 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0007_r_000000_0' done.
2015-02-10 16:16:08,494 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/mergecount/_temporary
2015-02-10 16:16:08,505 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:08,517 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:08,518 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/mergecount
2015-02-10 16:16:08,534 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:08,534 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:08,557 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [min] starting
2015-02-10 16:16:08,557 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [min]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:08,558 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [min]  sink: Hfs["TextDelimited[['char', 'min']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/minbynullsafety"]
2015-02-10 16:16:08,558 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [min]  parallel execution is enabled: false
2015-02-10 16:16:08,558 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [min]  starting jobs: 1
2015-02-10 16:16:08,558 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [min]  allocating threads: 1
2015-02-10 16:16:08,559 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [min] starting step: (1/1) ...splatform/minbynullsafety
2015-02-10 16:16:08,574 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:08,606 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [min] submitted hadoop job: job_local_0008
2015-02-10 16:16:08,607 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [min] tracking url: http://localhost:8080/
2015-02-10 16:16:08,611 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@305f387c
2015-02-10 16:16:08,613 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:08,614 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:08,615 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:08,765 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:08,766 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:08,767 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:08,768 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:08,779 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:08,779 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(min)[by:[{1}:'char']]
2015-02-10 16:16:08,780 INFO  assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:08,782 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:08,783 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 40, total: 561, max: 672
2015-02-10 16:16:08,784 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:08,785 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 40, total: 561, max: 672
2015-02-10 16:16:08,786 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:08,787 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 40, total: 561, max: 672
2015-02-10 16:16:08,788 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:08,789 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 40, total: 561, max: 672
2015-02-10 16:16:08,790 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:08,793 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:08,795 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0008_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:08,797 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:08,798 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0008_m_000000_0' done.
2015-02-10 16:16:08,803 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@4cc68351
2015-02-10 16:16:08,804 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:08,806 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:08,807 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 119 bytes
2015-02-10 16:16:08,807 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:08,809 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:08,809 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:08,820 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(min)[by:[{1}:'char']]
2015-02-10 16:16:08,820 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'min']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/minbynullsafety"]
2015-02-10 16:16:08,828 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0008_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:08,829 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:08,830 INFO  mapred.Task (Task.java:commit(1011)) - Task attempt_local_0008_r_000000_0 is allowed to commit now
2015-02-10 16:16:08,834 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0008_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/minbynullsafety
2015-02-10 16:16:08,835 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:08,836 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0008_r_000000_0' done.
2015-02-10 16:16:08,850 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/minbynullsafety/_temporary
2015-02-10 16:16:08,862 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:08,876 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:08,879 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/minbynullsafety
2015-02-10 16:16:08,898 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:08,899 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:08,926 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [max] starting
2015-02-10 16:16:08,927 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [max]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:08,927 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [max]  sink: Hfs["TextDelimited[['num', 'max']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/maxbystring"]
2015-02-10 16:16:08,928 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [max]  parallel execution is enabled: false
2015-02-10 16:16:08,928 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [max]  starting jobs: 1
2015-02-10 16:16:08,928 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [max]  allocating threads: 1
2015-02-10 16:16:08,929 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [max] starting step: (1/1) ...lpersplatform/maxbystring
2015-02-10 16:16:08,942 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:08,979 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [max] submitted hadoop job: job_local_0009
2015-02-10 16:16:08,980 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [max] tracking url: http://localhost:8080/
2015-02-10 16:16:08,984 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@f715510
2015-02-10 16:16:08,985 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:08,987 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:08,987 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:09,350 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:09,351 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:09,352 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:09,352 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:09,362 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:09,362 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(max)[by:[{1}:'num']]
2015-02-10 16:16:09,363 INFO  assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:09,365 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:09,365 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 134, total: 239, max: 672
2015-02-10 16:16:09,365 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 35% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:09,366 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:09,366 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 134, total: 239, max: 672
2015-02-10 16:16:09,366 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 35% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:09,367 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:09,369 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:09,371 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0009_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:09,373 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:09,373 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0009_m_000000_0' done.
2015-02-10 16:16:09,377 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@1f5b44d6
2015-02-10 16:16:09,378 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:09,379 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:09,379 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 87 bytes
2015-02-10 16:16:09,380 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:09,381 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:09,381 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:09,390 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(max)[by:[{1}:'num']]
2015-02-10 16:16:09,390 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['num', 'max']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/maxbystring"]
2015-02-10 16:16:09,396 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0009_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:09,397 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:09,398 INFO  mapred.Task (Task.java:commit(1011)) - Task attempt_local_0009_r_000000_0 is allowed to commit now
2015-02-10 16:16:09,401 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0009_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/maxbystring
2015-02-10 16:16:09,401 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:09,402 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0009_r_000000_0' done.
2015-02-10 16:16:09,414 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/maxbystring/_temporary
2015-02-10 16:16:09,424 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:09,436 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:09,438 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/maxbystring
2015-02-10 16:16:09,455 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:09,456 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:09,483 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [first] starting
2015-02-10 16:16:09,483 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [first]  source: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-10 16:16:09,484 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [first]  sink: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/firstnfields"]
2015-02-10 16:16:09,484 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [first]  parallel execution is enabled: false
2015-02-10 16:16:09,484 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [first]  starting jobs: 1
2015-02-10 16:16:09,485 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [first]  allocating threads: 1
2015-02-10 16:16:09,486 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [first] starting step: (1/1) ...persplatform/firstnfields
2015-02-10 16:16:09,499 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:09,526 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [first] submitted hadoop job: job_local_0010
2015-02-10 16:16:09,527 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [first] tracking url: http://localhost:8080/
2015-02-10 16:16:09,530 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@2b890c67
2015-02-10 16:16:09,532 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs+rhs-cross.txt
2015-02-10 16:16:09,533 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:09,533 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:09,673 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:09,673 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:09,676 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:09,677 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:09,685 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-10 16:16:09,685 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(first)[by:[{1}:'num']]
2015-02-10 16:16:09,686 INFO  assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:09,689 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:09,689 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 114, total: 334, max: 672
2015-02-10 16:16:09,690 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 49% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:09,691 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:09,691 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 114, total: 334, max: 672
2015-02-10 16:16:09,692 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 49% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:09,693 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:09,696 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:09,697 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0010_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:09,699 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2015-02-10 16:16:09,699 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0010_m_000000_0' done.
2015-02-10 16:16:09,703 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@64e48e45
2015-02-10 16:16:09,703 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:09,705 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:09,705 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 182 bytes
2015-02-10 16:16:09,706 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:09,707 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:09,707 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:09,714 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(first)[by:[{1}:'num']]
2015-02-10 16:16:09,715 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/firstnfields"]
2015-02-10 16:16:09,721 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0010_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:09,722 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:09,723 INFO  mapred.Task (Task.java:commit(1011)) - Task attempt_local_0010_r_000000_0 is allowed to commit now
2015-02-10 16:16:09,726 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0010_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/firstnfields
2015-02-10 16:16:09,726 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:09,727 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0010_r_000000_0' done.
2015-02-10 16:16:09,740 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/firstnfields/_temporary
2015-02-10 16:16:09,750 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:09,752 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/firstnfields
2015-02-10 16:16:09,769 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:09,769 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:09,791 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [coerce] starting
2015-02-10 16:16:09,791 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [coerce]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt"]
2015-02-10 16:16:09,791 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [coerce]  sink: Hfs["TextLine[['line']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/coercefields"]
2015-02-10 16:16:09,792 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [coerce]  parallel execution is enabled: false
2015-02-10 16:16:09,792 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [coerce]  starting jobs: 1
2015-02-10 16:16:09,792 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [coerce]  allocating threads: 1
2015-02-10 16:16:09,793 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [coerce] starting step: (1/1) ...persplatform/coercefields
2015-02-10 16:16:09,803 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:09,828 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [coerce] submitted hadoop job: job_local_0011
2015-02-10 16:16:09,828 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [coerce] tracking url: http://localhost:8080/
2015-02-10 16:16:09,832 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@6d4e5d57
2015-02-10 16:16:09,834 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt
2015-02-10 16:16:09,835 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 0
2015-02-10 16:16:09,839 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:09,839 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:09,847 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt"]
2015-02-10 16:16:09,848 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['line']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/coercefields"]
2015-02-10 16:16:09,857 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0011_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:09,857 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:09,858 INFO  mapred.Task (Task.java:commit(1011)) - Task attempt_local_0011_m_000000_0 is allowed to commit now
2015-02-10 16:16:09,862 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0011_m_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/coercefields
2015-02-10 16:16:09,863 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt:0+19
2015-02-10 16:16:09,864 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0011_m_000000_0' done.
2015-02-10 16:16:09,869 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/coercefields/_temporary
2015-02-10 16:16:09,879 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:09,881 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/coercefields
2015-02-10 16:16:09,894 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:09,896 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:09,913 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [count] starting
2015-02-10 16:16:09,914 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [count]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:09,914 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [count]  sink: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/count"]
2015-02-10 16:16:09,914 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [count]  parallel execution is enabled: false
2015-02-10 16:16:09,914 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [count]  starting jobs: 1
2015-02-10 16:16:09,915 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [count]  allocating threads: 1
2015-02-10 16:16:09,915 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] starting step: (1/1) ...mblyhelpersplatform/count
2015-02-10 16:16:09,926 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:09,951 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] submitted hadoop job: job_local_0012
2015-02-10 16:16:09,951 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] tracking url: http://localhost:8080/
2015-02-10 16:16:09,956 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@3639b3a2
2015-02-10 16:16:09,957 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:09,958 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:09,959 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:10,115 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:10,115 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:10,116 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:10,117 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:10,125 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:10,126 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(count)[by:[{1}:'char']]
2015-02-10 16:16:10,126 INFO  assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:10,127 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:10,128 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 86, total: 429, max: 672
2015-02-10 16:16:10,128 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 63% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:10,129 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:10,129 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 86, total: 429, max: 672
2015-02-10 16:16:10,129 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 63% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:10,130 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:10,130 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 86, total: 429, max: 672
2015-02-10 16:16:10,130 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 63% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:10,131 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:10,131 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 86, total: 429, max: 672
2015-02-10 16:16:10,131 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 63% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:10,132 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:10,134 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:10,136 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0012_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:10,137 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:10,138 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0012_m_000000_0' done.
2015-02-10 16:16:10,142 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@347cdb
2015-02-10 16:16:10,142 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:10,143 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:10,144 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 119 bytes
2015-02-10 16:16:10,144 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:10,145 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:10,146 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:10,155 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(count)[by:[{1}:'char']]
2015-02-10 16:16:10,155 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/count"]
2015-02-10 16:16:10,161 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0012_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:10,162 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:10,162 INFO  mapred.Task (Task.java:commit(1011)) - Task attempt_local_0012_r_000000_0 is allowed to commit now
2015-02-10 16:16:10,165 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0012_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/count
2015-02-10 16:16:10,166 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:10,167 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0012_r_000000_0' done.
2015-02-10 16:16:10,176 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/count/_temporary
2015-02-10 16:16:10,185 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:10,197 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:10,199 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/count
2015-02-10 16:16:10,215 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:10,216 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:10,234 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [max] starting
2015-02-10 16:16:10,235 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [max]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:10,235 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [max]  sink: Hfs["TextDelimited[['char', 'max']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/maxby"]
2015-02-10 16:16:10,235 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [max]  parallel execution is enabled: false
2015-02-10 16:16:10,236 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [max]  starting jobs: 1
2015-02-10 16:16:10,236 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [max]  allocating threads: 1
2015-02-10 16:16:10,236 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [max] starting step: (1/1) ...mblyhelpersplatform/maxby
2015-02-10 16:16:10,247 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:10,271 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [max] submitted hadoop job: job_local_0013
2015-02-10 16:16:10,274 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [max] tracking url: http://localhost:8080/
2015-02-10 16:16:10,277 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@57102fab
2015-02-10 16:16:10,280 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:10,281 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:10,282 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:10,438 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:10,438 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:10,440 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:10,440 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:10,449 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:10,450 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(max)[by:[{1}:'char']]
2015-02-10 16:16:10,450 INFO  assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:10,452 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:10,452 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 68, total: 524, max: 672
2015-02-10 16:16:10,452 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 77% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:10,453 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:10,453 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 68, total: 524, max: 672
2015-02-10 16:16:10,454 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 77% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:10,454 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:10,455 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 68, total: 524, max: 672
2015-02-10 16:16:10,455 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 77% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:10,456 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:10,456 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 68, total: 524, max: 672
2015-02-10 16:16:10,456 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 77% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:10,457 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:10,460 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:10,461 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0013_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:10,463 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:10,464 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0013_m_000000_0' done.
2015-02-10 16:16:10,468 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@352e71c4
2015-02-10 16:16:10,468 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:10,469 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:10,470 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 155 bytes
2015-02-10 16:16:10,470 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:10,471 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:10,471 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:10,480 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(max)[by:[{1}:'char']]
2015-02-10 16:16:10,481 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'max']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/maxby"]
2015-02-10 16:16:10,487 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0013_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:10,488 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:10,489 INFO  mapred.Task (Task.java:commit(1011)) - Task attempt_local_0013_r_000000_0 is allowed to commit now
2015-02-10 16:16:10,492 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0013_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/maxby
2015-02-10 16:16:10,492 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:10,493 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0013_r_000000_0' done.
2015-02-10 16:16:10,497 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/maxby/_temporary
2015-02-10 16:16:10,508 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:10,520 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:10,522 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/maxby
2015-02-10 16:16:10,537 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:10,538 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:10,555 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [min] starting
2015-02-10 16:16:10,556 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [min]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:10,566 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [min]  sink: Hfs["TextDelimited[['char', 'min']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/minby"]
2015-02-10 16:16:10,566 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [min]  parallel execution is enabled: false
2015-02-10 16:16:10,567 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [min]  starting jobs: 1
2015-02-10 16:16:10,567 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [min]  allocating threads: 1
2015-02-10 16:16:10,568 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [min] starting step: (1/1) ...mblyhelpersplatform/minby
2015-02-10 16:16:10,578 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:10,601 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [min] submitted hadoop job: job_local_0014
2015-02-10 16:16:10,602 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [min] tracking url: http://localhost:8080/
2015-02-10 16:16:10,604 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@47b6617
2015-02-10 16:16:10,606 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:10,607 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:10,607 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:10,740 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:10,740 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:10,742 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:10,742 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:10,750 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:10,750 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(min)[by:[{1}:'char']]
2015-02-10 16:16:10,751 INFO  assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:10,752 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:10,752 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 96, total: 591, max: 672
2015-02-10 16:16:10,753 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:10,753 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 96, total: 591, max: 672
2015-02-10 16:16:10,754 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:10,754 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 96, total: 591, max: 672
2015-02-10 16:16:10,755 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:10,755 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 96, total: 591, max: 672
2015-02-10 16:16:10,756 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:10,758 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:10,759 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0014_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:10,760 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:10,761 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0014_m_000000_0' done.
2015-02-10 16:16:10,764 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@7192efd
2015-02-10 16:16:10,765 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:10,766 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:10,766 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 155 bytes
2015-02-10 16:16:10,767 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:10,767 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:10,768 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:10,775 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(min)[by:[{1}:'char']]
2015-02-10 16:16:10,775 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'min']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/minby"]
2015-02-10 16:16:10,780 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0014_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:10,781 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:10,782 INFO  mapred.Task (Task.java:commit(1011)) - Task attempt_local_0014_r_000000_0 is allowed to commit now
2015-02-10 16:16:10,784 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0014_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/minby
2015-02-10 16:16:10,784 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:10,785 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0014_r_000000_0' done.
2015-02-10 16:16:10,794 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/minby/_temporary
2015-02-10 16:16:10,804 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:10,814 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:10,815 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/minby
2015-02-10 16:16:10,827 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:10,828 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:10,844 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [sum] starting
2015-02-10 16:16:10,844 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [sum]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:10,844 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [sum]  sink: Hfs["TextDelimited[['char', 'sum']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/sum"]
2015-02-10 16:16:10,844 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [sum]  parallel execution is enabled: false
2015-02-10 16:16:10,845 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [sum]  starting jobs: 1
2015-02-10 16:16:10,845 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [sum]  allocating threads: 1
2015-02-10 16:16:10,845 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [sum] starting step: (1/1) ...semblyhelpersplatform/sum
2015-02-10 16:16:10,856 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:10,880 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [sum] submitted hadoop job: job_local_0015
2015-02-10 16:16:10,880 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [sum] tracking url: http://localhost:8080/
2015-02-10 16:16:10,883 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@1c90a278
2015-02-10 16:16:10,884 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:10,885 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:10,886 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:11,193 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:11,194 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:11,195 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:11,195 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:11,205 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:11,205 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(sum)[by:[{1}:'char']]
2015-02-10 16:16:11,205 INFO  assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:11,207 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:11,207 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 83, total: 188, max: 672
2015-02-10 16:16:11,207 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 27% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:11,208 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:11,209 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 83, total: 188, max: 672
2015-02-10 16:16:11,209 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 27% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:11,210 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:11,210 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 83, total: 188, max: 672
2015-02-10 16:16:11,210 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 27% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:11,211 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:11,211 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 83, total: 188, max: 672
2015-02-10 16:16:11,211 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 27% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:11,212 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:11,215 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:11,217 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0015_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:11,218 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:11,219 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0015_m_000000_0' done.
2015-02-10 16:16:11,223 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@655538e5
2015-02-10 16:16:11,223 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:11,224 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:11,225 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 119 bytes
2015-02-10 16:16:11,225 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:11,226 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:11,226 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:11,235 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(sum)[by:[{1}:'char']]
2015-02-10 16:16:11,235 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'sum']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/sum"]
2015-02-10 16:16:11,241 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0015_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:11,242 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:11,243 INFO  mapred.Task (Task.java:commit(1011)) - Task attempt_local_0015_r_000000_0 is allowed to commit now
2015-02-10 16:16:11,245 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0015_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/sum
2015-02-10 16:16:11,246 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:11,247 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0015_r_000000_0' done.
2015-02-10 16:16:11,255 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/sum/_temporary
2015-02-10 16:16:11,266 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:11,278 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:11,281 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/sum
2015-02-10 16:16:11,298 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:11,299 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:11,323 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [sum-lhs+sum-rhs] starting
2015-02-10 16:16:11,323 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [sum-lhs+sum-rhs]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt"]
2015-02-10 16:16:11,324 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [sum-lhs+sum-rhs]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:11,324 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [sum-lhs+sum-rhs]  sink: Hfs["TextDelimited[['char', 'sum']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/mergesum"]
2015-02-10 16:16:11,324 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [sum-lhs+sum-rhs]  parallel execution is enabled: false
2015-02-10 16:16:11,324 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [sum-lhs+sum-rhs]  starting jobs: 1
2015-02-10 16:16:11,325 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [sum-lhs+sum-rhs]  allocating threads: 1
2015-02-10 16:16:11,325 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [sum-lhs+sum-rhs] starting step: (1/1) ...yhelpersplatform/mergesum
2015-02-10 16:16:11,335 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:11,336 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:11,367 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [sum-lhs+sum-rhs] submitted hadoop job: job_local_0016
2015-02-10 16:16:11,368 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [sum-lhs+sum-rhs] tracking url: http://localhost:8080/
2015-02-10 16:16:11,370 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@35718057
2015-02-10 16:16:11,372 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:11,373 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:11,374 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:11,459 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:11,460 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:11,461 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:11,462 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:11,471 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:11,471 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(sum-lhs+sum-rhs)[by: sum-lhs:[{1}:'char'] sum-rhs:[{1}:'char']]
2015-02-10 16:16:11,472 INFO  assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:11,473 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:11,474 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 174, total: 285, max: 672
2015-02-10 16:16:11,474 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 42% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:11,475 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:11,475 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 173, total: 285, max: 672
2015-02-10 16:16:11,475 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 42% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:11,476 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:11,476 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 173, total: 285, max: 672
2015-02-10 16:16:11,476 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 42% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:11,477 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:11,477 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 173, total: 285, max: 672
2015-02-10 16:16:11,477 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 42% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:11,478 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:11,480 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:11,482 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0016_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:11,483 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:11,484 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0016_m_000000_0' done.
2015-02-10 16:16:11,485 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@356a90c9
2015-02-10 16:16:11,487 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt
2015-02-10 16:16:11,488 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:11,488 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:11,508 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:11,508 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:11,510 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:11,510 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:11,519 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt"]
2015-02-10 16:16:11,519 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(sum-lhs+sum-rhs)[by: sum-lhs:[{1}:'char'] sum-rhs:[{1}:'char']]
2015-02-10 16:16:11,520 INFO  assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:11,524 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:11,524 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 71, total: 285, max: 672
2015-02-10 16:16:11,524 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 42% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:11,525 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:11,525 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 71, total: 285, max: 672
2015-02-10 16:16:11,525 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 42% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:11,526 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:11,526 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 71, total: 285, max: 672
2015-02-10 16:16:11,527 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 42% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:11,527 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:11,528 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 71, total: 285, max: 672
2015-02-10 16:16:11,528 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 42% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:11,528 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:11,531 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:11,532 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0016_m_000001_0 is done. And is in the process of commiting
2015-02-10 16:16:11,533 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt:0+51
2015-02-10 16:16:11,534 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0016_m_000001_0' done.
2015-02-10 16:16:11,540 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@14f30093
2015-02-10 16:16:11,540 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:11,542 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 2 sorted segments
2015-02-10 16:16:11,542 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 2 segments left of total size: 238 bytes
2015-02-10 16:16:11,543 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:11,544 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:11,544 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:11,552 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(sum-lhs+sum-rhs)[by: sum-lhs:[{1}:'char'] sum-rhs:[{1}:'char']]
2015-02-10 16:16:11,552 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'sum']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/mergesum"]
2015-02-10 16:16:11,559 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0016_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:11,560 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:11,560 INFO  mapred.Task (Task.java:commit(1011)) - Task attempt_local_0016_r_000000_0 is allowed to commit now
2015-02-10 16:16:11,563 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0016_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/mergesum
2015-02-10 16:16:11,563 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:11,564 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0016_r_000000_0' done.
2015-02-10 16:16:11,571 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/mergesum/_temporary
2015-02-10 16:16:11,582 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:11,592 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:11,593 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/mergesum
2015-02-10 16:16:11,605 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:11,606 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:11,618 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [shape] starting
2015-02-10 16:16:11,618 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [shape]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt"]
2015-02-10 16:16:11,619 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [shape]  sink: Hfs["TextLine[['num']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/discardnarrow"]
2015-02-10 16:16:11,619 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [shape]  parallel execution is enabled: false
2015-02-10 16:16:11,619 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [shape]  starting jobs: 1
2015-02-10 16:16:11,619 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [shape]  allocating threads: 1
2015-02-10 16:16:11,620 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] starting step: (1/1) ...ersplatform/discardnarrow
2015-02-10 16:16:11,628 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:11,657 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] submitted hadoop job: job_local_0017
2015-02-10 16:16:11,657 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] tracking url: http://localhost:8080/
2015-02-10 16:16:11,660 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@2cd90727
2015-02-10 16:16:11,662 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt
2015-02-10 16:16:11,672 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 0
2015-02-10 16:16:11,726 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:11,726 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:11,731 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt"]
2015-02-10 16:16:11,731 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['num']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/discardnarrow"]
2015-02-10 16:16:11,733 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0017_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:11,734 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:11,734 INFO  mapred.Task (Task.java:commit(1011)) - Task attempt_local_0017_m_000000_0 is allowed to commit now
2015-02-10 16:16:11,737 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0017_m_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/discardnarrow
2015-02-10 16:16:11,737 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt:0+19
2015-02-10 16:16:11,738 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0017_m_000000_0' done.
2015-02-10 16:16:11,742 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/discardnarrow/_temporary
2015-02-10 16:16:11,750 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:11,752 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/discardnarrow
2015-02-10 16:16:11,763 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:11,763 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:11,773 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [shape] starting
2015-02-10 16:16:11,774 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [shape]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt"]
2015-02-10 16:16:11,774 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [shape]  sink: Hfs["TextLine[['line']->['item', 'element']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/rename"]
2015-02-10 16:16:11,774 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [shape]  parallel execution is enabled: false
2015-02-10 16:16:11,774 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [shape]  starting jobs: 1
2015-02-10 16:16:11,774 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [shape]  allocating threads: 1
2015-02-10 16:16:11,775 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] starting step: (1/1) ...blyhelpersplatform/rename
2015-02-10 16:16:11,783 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:11,805 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] submitted hadoop job: job_local_0018
2015-02-10 16:16:11,805 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] tracking url: http://localhost:8080/
2015-02-10 16:16:11,808 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@1ff05076
2015-02-10 16:16:11,809 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt
2015-02-10 16:16:11,810 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 0
2015-02-10 16:16:11,813 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:11,813 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:11,818 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt"]
2015-02-10 16:16:11,818 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['line']->['item', 'element']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/rename"]
2015-02-10 16:16:11,820 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0018_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:11,820 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:11,821 INFO  mapred.Task (Task.java:commit(1011)) - Task attempt_local_0018_m_000000_0 is allowed to commit now
2015-02-10 16:16:11,823 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0018_m_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/rename
2015-02-10 16:16:11,824 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt:0+19
2015-02-10 16:16:11,824 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0018_m_000000_0' done.
2015-02-10 16:16:11,836 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/rename/_temporary
2015-02-10 16:16:11,845 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:11,846 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/rename
2015-02-10 16:16:11,862 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:11,862 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:11,885 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [name] starting
2015-02-10 16:16:11,886 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [name]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt"]
2015-02-10 16:16:11,886 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [name]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:11,886 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [name]  sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/multimerge+true"]
2015-02-10 16:16:11,886 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [name]  parallel execution is enabled: false
2015-02-10 16:16:11,886 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [name]  starting jobs: 1
2015-02-10 16:16:11,887 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [name]  allocating threads: 1
2015-02-10 16:16:11,887 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [name] starting step: (1/1) ...splatform/multimerge+true
2015-02-10 16:16:11,896 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:11,897 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:11,919 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [name] submitted hadoop job: job_local_0019
2015-02-10 16:16:11,919 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [name] tracking url: http://localhost:8080/
2015-02-10 16:16:11,922 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@70d9cc1a
2015-02-10 16:16:11,923 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:11,924 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:11,925 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:11,944 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:11,944 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:11,946 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:11,946 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:11,957 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:11,957 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2015-02-10 16:16:11,959 INFO  assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:11,960 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:11,960 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 111, total: 341, max: 672
2015-02-10 16:16:11,960 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 50% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:11,962 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:11,962 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 111, total: 341, max: 672
2015-02-10 16:16:11,962 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 50% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:11,963 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:11,963 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 111, total: 341, max: 672
2015-02-10 16:16:11,963 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 50% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:11,964 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:11,964 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 111, total: 341, max: 672
2015-02-10 16:16:11,964 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 50% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:11,965 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:11,967 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:11,969 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0019_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:11,970 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:11,971 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0019_m_000000_0' done.
2015-02-10 16:16:11,972 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@6013a567
2015-02-10 16:16:11,974 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt
2015-02-10 16:16:11,975 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:11,975 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:12,136 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:12,136 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:12,139 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:12,139 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:12,151 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt"]
2015-02-10 16:16:12,151 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2015-02-10 16:16:12,152 INFO  assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:12,156 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:12,157 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 103, total: 436, max: 672
2015-02-10 16:16:12,157 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 64% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:12,158 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:12,159 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 103, total: 436, max: 672
2015-02-10 16:16:12,159 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 64% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:12,160 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:12,160 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 103, total: 436, max: 672
2015-02-10 16:16:12,161 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 64% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:12,162 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:12,162 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 103, total: 436, max: 672
2015-02-10 16:16:12,162 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 64% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:12,163 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:12,166 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:12,167 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0019_m_000001_0 is done. And is in the process of commiting
2015-02-10 16:16:12,169 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt:0+51
2015-02-10 16:16:12,170 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0019_m_000001_0' done.
2015-02-10 16:16:12,176 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@6c12a801
2015-02-10 16:16:12,176 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:12,179 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 2 sorted segments
2015-02-10 16:16:12,183 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 2 segments left of total size: 472 bytes
2015-02-10 16:16:12,183 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:12,185 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:12,185 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:12,197 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(name)[by:[{1}:'char']]
2015-02-10 16:16:12,197 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/multimerge+true"]
2015-02-10 16:16:12,206 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0019_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:12,207 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:12,208 INFO  mapred.Task (Task.java:commit(1011)) - Task attempt_local_0019_r_000000_0 is allowed to commit now
2015-02-10 16:16:12,211 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0019_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/multimerge+true
2015-02-10 16:16:12,212 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:12,213 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0019_r_000000_0' done.
2015-02-10 16:16:12,223 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/multimerge+true/_temporary
2015-02-10 16:16:12,233 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:12,245 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:12,247 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/multimerge+true
2015-02-10 16:16:12,267 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:12,268 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:12,307 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [second] starting
2015-02-10 16:16:12,308 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [second]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:12,308 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [second]  sink: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/samesourcemergecount"]
2015-02-10 16:16:12,308 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [second]  parallel execution is enabled: false
2015-02-10 16:16:12,308 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [second]  starting jobs: 2
2015-02-10 16:16:12,309 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [second]  allocating threads: 1
2015-02-10 16:16:12,309 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [second] starting step: (1/2)
2015-02-10 16:16:12,319 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:12,347 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [second] submitted hadoop job: job_local_0020
2015-02-10 16:16:12,347 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [second] tracking url: http://localhost:8080/
2015-02-10 16:16:12,350 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@1b0585c7
2015-02-10 16:16:12,352 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:12,353 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:12,353 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:12,509 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:12,509 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:12,511 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:12,511 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:12,520 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:12,521 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(first)[by:[{1}:'char']]
2015-02-10 16:16:12,521 INFO  assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:12,525 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:12,525 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 81, total: 531, max: 672
2015-02-10 16:16:12,526 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 79% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:12,527 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:12,527 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 81, total: 531, max: 672
2015-02-10 16:16:12,527 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 79% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:12,528 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:12,528 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 81, total: 531, max: 672
2015-02-10 16:16:12,529 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 79% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:12,529 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:12,530 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 81, total: 531, max: 672
2015-02-10 16:16:12,530 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 79% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:12,531 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:12,533 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:12,535 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0020_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:12,536 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:12,537 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0020_m_000000_0' done.
2015-02-10 16:16:12,541 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@3274eb8a
2015-02-10 16:16:12,541 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:12,542 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:12,543 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 119 bytes
2015-02-10 16:16:12,543 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:12,544 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:12,545 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:12,552 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(first)[by:[{1}:'char']]
2015-02-10 16:16:12,553 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: TempHfs["SequenceFile[['char', 'count']]"][8372234188/first/]
2015-02-10 16:16:12,558 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0020_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:12,558 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:12,559 INFO  mapred.Task (Task.java:commit(1011)) - Task attempt_local_0020_r_000000_0 is allowed to commit now
2015-02-10 16:16:12,562 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0020_r_000000_0' to file:/tmp/hadoop-teamcity/8372234188_first_3495EFE8D5974B688FB0738034BE429E
2015-02-10 16:16:12,562 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:12,563 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0020_r_000000_0' done.
2015-02-10 16:16:12,570 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [second] starting step: (2/2) ...form/samesourcemergecount
2015-02-10 16:16:12,579 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:12,608 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [second] submitted hadoop job: job_local_0021
2015-02-10 16:16:12,608 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [second] tracking url: http://localhost:8080/
2015-02-10 16:16:12,611 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@7c5acf13
2015-02-10 16:16:12,612 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/8372234188_first_3495EFE8D5974B688FB0738034BE429E/part-00000
2015-02-10 16:16:12,614 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:12,614 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:12,752 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:12,753 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:12,754 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:12,754 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:12,765 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][8372234188/first/]
2015-02-10 16:16:12,765 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(second)[by:[{1}:'char']]
2015-02-10 16:16:12,766 INFO  assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:12,767 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:12,767 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 68, total: 626, max: 672
2015-02-10 16:16:12,768 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:12,768 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 68, total: 626, max: 672
2015-02-10 16:16:12,769 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:12,771 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:12,773 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0021_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:12,774 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/tmp/hadoop-teamcity/8372234188_first_3495EFE8D5974B688FB0738034BE429E/part-00000:0+160
2015-02-10 16:16:12,775 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0021_m_000000_0' done.
2015-02-10 16:16:12,779 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@74a893ff
2015-02-10 16:16:12,779 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:12,780 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:12,781 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 67 bytes
2015-02-10 16:16:12,781 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:12,782 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:12,782 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:12,792 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(second)[by:[{1}:'char']]
2015-02-10 16:16:12,792 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/samesourcemergecount"]
2015-02-10 16:16:12,797 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0021_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:12,798 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:12,799 INFO  mapred.Task (Task.java:commit(1011)) - Task attempt_local_0021_r_000000_0 is allowed to commit now
2015-02-10 16:16:12,802 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0021_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/samesourcemergecount
2015-02-10 16:16:12,802 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:12,803 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0021_r_000000_0' done.
2015-02-10 16:16:12,811 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/samesourcemergecount/_temporary
2015-02-10 16:16:12,822 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:12,834 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:12,836 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/samesourcemergecount
2015-02-10 16:16:12,853 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:12,854 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:12,868 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [average] starting
2015-02-10 16:16:12,869 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [average]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:12,869 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [average]  sink: Hfs["TextDelimited[['char', 'average']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/average"]
2015-02-10 16:16:12,869 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [average]  parallel execution is enabled: false
2015-02-10 16:16:12,869 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [average]  starting jobs: 1
2015-02-10 16:16:12,869 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [average]  allocating threads: 1
2015-02-10 16:16:12,870 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [average] starting step: (1/1) ...lyhelpersplatform/average
2015-02-10 16:16:12,879 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:12,913 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [average] submitted hadoop job: job_local_0022
2015-02-10 16:16:12,913 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [average] tracking url: http://localhost:8080/
2015-02-10 16:16:12,917 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@49e5ab72
2015-02-10 16:16:12,919 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:12,920 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:12,920 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:12,939 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:12,940 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:12,941 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:12,941 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:12,949 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:12,950 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(average)[by:[{1}:'char']]
2015-02-10 16:16:12,950 INFO  assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:12,952 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:12,952 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 133, total: 629, max: 672
2015-02-10 16:16:12,953 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:12,953 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 133, total: 629, max: 672
2015-02-10 16:16:12,955 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:12,956 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 133, total: 629, max: 672
2015-02-10 16:16:12,956 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:12,957 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 133, total: 629, max: 672
2015-02-10 16:16:12,957 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:12,960 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:12,961 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0022_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:12,962 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:12,963 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0022_m_000000_0' done.
2015-02-10 16:16:12,967 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@bb081e3
2015-02-10 16:16:12,967 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:12,968 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:12,968 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 200 bytes
2015-02-10 16:16:12,969 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:12,970 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:12,970 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:12,976 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(average)[by:[{1}:'char']]
2015-02-10 16:16:12,976 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'average']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/average"]
2015-02-10 16:16:12,982 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0022_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:12,982 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:12,983 INFO  mapred.Task (Task.java:commit(1011)) - Task attempt_local_0022_r_000000_0 is allowed to commit now
2015-02-10 16:16:12,986 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0022_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/average
2015-02-10 16:16:12,986 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:12,989 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0022_r_000000_0' done.
2015-02-10 16:16:13,000 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/average/_temporary
2015-02-10 16:16:13,008 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:13,018 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:13,020 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/average
2015-02-10 16:16:13,032 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:13,032 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:13,043 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [max] starting
2015-02-10 16:16:13,044 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [max]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:13,044 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [max]  sink: Hfs["TextDelimited[['char', 'max']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/maxbynullsafety"]
2015-02-10 16:16:13,044 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [max]  parallel execution is enabled: false
2015-02-10 16:16:13,045 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [max]  starting jobs: 1
2015-02-10 16:16:13,045 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [max]  allocating threads: 1
2015-02-10 16:16:13,046 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [max] starting step: (1/1) ...splatform/maxbynullsafety
2015-02-10 16:16:13,055 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:13,079 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [max] submitted hadoop job: job_local_0023
2015-02-10 16:16:13,080 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [max] tracking url: http://localhost:8080/
2015-02-10 16:16:13,082 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@78d15e01
2015-02-10 16:16:13,084 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:13,085 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:13,085 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:13,241 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:13,241 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:13,242 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:13,242 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:13,249 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:13,250 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(max)[by:[{1}:'char']]
2015-02-10 16:16:13,250 INFO  assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:13,251 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:13,252 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 81, total: 692, max: 692
2015-02-10 16:16:13,253 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:13,253 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 81, total: 692, max: 692
2015-02-10 16:16:13,254 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:13,254 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 81, total: 692, max: 692
2015-02-10 16:16:13,254 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:13,255 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 81, total: 692, max: 692
2015-02-10 16:16:13,255 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:13,258 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:13,259 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0023_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:13,260 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:13,261 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0023_m_000000_0' done.
2015-02-10 16:16:13,264 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@5cd37d44
2015-02-10 16:16:13,264 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:13,266 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:13,266 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 118 bytes
2015-02-10 16:16:13,266 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:13,267 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:13,267 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:13,274 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(max)[by:[{1}:'char']]
2015-02-10 16:16:13,274 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'max']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/maxbynullsafety"]
2015-02-10 16:16:13,279 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0023_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:13,279 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:13,280 INFO  mapred.Task (Task.java:commit(1011)) - Task attempt_local_0023_r_000000_0 is allowed to commit now
2015-02-10 16:16:13,283 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0023_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/maxbynullsafety
2015-02-10 16:16:13,283 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:13,284 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0023_r_000000_0' done.
2015-02-10 16:16:13,293 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/maxbynullsafety/_temporary
2015-02-10 16:16:13,301 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:13,311 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:13,313 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/maxbynullsafety
2015-02-10 16:16:13,325 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:13,325 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:13,338 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [sum] starting
2015-02-10 16:16:13,338 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [sum]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:13,339 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [sum]  sink: Hfs["TextDelimited[['char', 'sum']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/sumnulls"]
2015-02-10 16:16:13,339 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [sum]  parallel execution is enabled: false
2015-02-10 16:16:13,339 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [sum]  starting jobs: 1
2015-02-10 16:16:13,339 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [sum]  allocating threads: 1
2015-02-10 16:16:13,340 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [sum] starting step: (1/1) ...yhelpersplatform/sumnulls
2015-02-10 16:16:13,349 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:13,379 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [sum] submitted hadoop job: job_local_0024
2015-02-10 16:16:13,379 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [sum] tracking url: http://localhost:8080/
2015-02-10 16:16:13,382 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@10f946f9
2015-02-10 16:16:13,383 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:13,385 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:13,385 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:13,683 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:13,683 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:13,684 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:13,685 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:13,691 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:13,691 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(sum)[by:[{1}:'char']]
2015-02-10 16:16:13,692 INFO  assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:13,701 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:13,701 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 146, total: 252, max: 672
2015-02-10 16:16:13,702 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 37% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:13,703 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:13,703 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 146, total: 252, max: 672
2015-02-10 16:16:13,703 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 37% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:13,704 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:13,704 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 146, total: 252, max: 672
2015-02-10 16:16:13,704 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 37% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:13,705 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:13,705 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 146, total: 252, max: 672
2015-02-10 16:16:13,705 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 37% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:13,706 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:13,708 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:13,709 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0024_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:13,710 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:13,711 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0024_m_000000_0' done.
2015-02-10 16:16:13,714 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@3107eafc
2015-02-10 16:16:13,714 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:13,716 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:13,716 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 116 bytes
2015-02-10 16:16:13,716 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:13,717 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:13,717 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:13,723 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(sum)[by:[{1}:'char']]
2015-02-10 16:16:13,723 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'sum']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/sumnulls"]
2015-02-10 16:16:13,728 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0024_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:13,729 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:13,730 INFO  mapred.Task (Task.java:commit(1011)) - Task attempt_local_0024_r_000000_0 is allowed to commit now
2015-02-10 16:16:13,732 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0024_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/sumnulls
2015-02-10 16:16:13,732 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:13,733 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0024_r_000000_0' done.
2015-02-10 16:16:13,737 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/sumnulls/_temporary
2015-02-10 16:16:13,746 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:13,755 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:13,757 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/sumnulls
2015-02-10 16:16:13,768 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:13,769 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:13,780 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [count] starting
2015-02-10 16:16:13,780 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [count]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:13,780 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [count]  sink: Hfs["TextDelimited[['count']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/countall"]
2015-02-10 16:16:13,781 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [count]  parallel execution is enabled: false
2015-02-10 16:16:13,781 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [count]  starting jobs: 1
2015-02-10 16:16:13,781 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [count]  allocating threads: 1
2015-02-10 16:16:13,782 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] starting step: (1/1) ...yhelpersplatform/countall
2015-02-10 16:16:13,790 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:13,814 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] submitted hadoop job: job_local_0025
2015-02-10 16:16:13,815 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] tracking url: http://localhost:8080/
2015-02-10 16:16:13,817 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@2bebde03
2015-02-10 16:16:13,819 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:13,820 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:13,820 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:13,890 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:13,890 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:13,891 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:13,892 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:13,899 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:13,899 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(count)[by:[{?}:NONE]]
2015-02-10 16:16:13,900 INFO  assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:13,902 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:13,903 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:13,905 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0025_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:13,906 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:13,906 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0025_m_000000_0' done.
2015-02-10 16:16:13,910 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@24458e29
2015-02-10 16:16:13,910 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:13,911 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:13,911 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 8 bytes
2015-02-10 16:16:13,912 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:13,912 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:13,913 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:13,919 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(count)[by:[{?}:NONE]]
2015-02-10 16:16:13,919 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['count']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/countall"]
2015-02-10 16:16:13,923 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0025_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:13,923 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:13,924 INFO  mapred.Task (Task.java:commit(1011)) - Task attempt_local_0025_r_000000_0 is allowed to commit now
2015-02-10 16:16:13,927 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0025_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/countall
2015-02-10 16:16:13,927 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:13,928 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0025_r_000000_0' done.
2015-02-10 16:16:13,937 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/countall/_temporary
2015-02-10 16:16:13,946 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:13,955 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:13,956 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/countall
2015-02-10 16:16:13,970 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:13,971 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:13,985 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [name] starting
2015-02-10 16:16:13,986 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [name]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:13,986 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [name]  sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average', 'average2', 'first']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/multi"]
2015-02-10 16:16:13,986 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [name]  parallel execution is enabled: false
2015-02-10 16:16:13,987 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [name]  starting jobs: 1
2015-02-10 16:16:13,987 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [name]  allocating threads: 1
2015-02-10 16:16:13,988 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [name] starting step: (1/1) ...mblyhelpersplatform/multi
2015-02-10 16:16:13,996 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:14,018 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [name] submitted hadoop job: job_local_0026
2015-02-10 16:16:14,018 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [name] tracking url: http://localhost:8080/
2015-02-10 16:16:14,022 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@28a38b58
2015-02-10 16:16:14,023 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:14,024 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:14,025 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:14,175 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:14,175 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:14,177 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:14,177 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:14,188 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:14,188 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2015-02-10 16:16:14,189 INFO  assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:14,191 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:14,191 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 106, total: 442, max: 672
2015-02-10 16:16:14,192 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 65% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:14,193 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:14,194 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 106, total: 442, max: 672
2015-02-10 16:16:14,194 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 65% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:14,196 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:14,196 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 106, total: 442, max: 672
2015-02-10 16:16:14,196 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 65% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:14,198 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:14,198 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 106, total: 442, max: 672
2015-02-10 16:16:14,198 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 65% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:14,199 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:14,202 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:14,204 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0026_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:14,205 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:14,206 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0026_m_000000_0' done.
2015-02-10 16:16:14,209 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@79b1a66b
2015-02-10 16:16:14,210 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:14,212 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:14,212 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 452 bytes
2015-02-10 16:16:14,214 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:14,217 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:14,217 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:14,226 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(name)[by:[{1}:'char']]
2015-02-10 16:16:14,226 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average', 'average2', 'first']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/multi"]
2015-02-10 16:16:14,233 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0026_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:14,234 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:14,235 INFO  mapred.Task (Task.java:commit(1011)) - Task attempt_local_0026_r_000000_0 is allowed to commit now
2015-02-10 16:16:14,237 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0026_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/multi
2015-02-10 16:16:14,237 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:14,238 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0026_r_000000_0' done.
2015-02-10 16:16:14,241 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/multi/_temporary
2015-02-10 16:16:14,250 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:14,260 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:14,262 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/multi
2015-02-10 16:16:14,272 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:14,272 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:14,282 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [shape] starting
2015-02-10 16:16:14,282 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [shape]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt"]
2015-02-10 16:16:14,283 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [shape]  sink: Hfs["TextLine[['num']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/retainnarrow"]
2015-02-10 16:16:14,283 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [shape]  parallel execution is enabled: false
2015-02-10 16:16:14,283 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [shape]  starting jobs: 1
2015-02-10 16:16:14,283 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [shape]  allocating threads: 1
2015-02-10 16:16:14,284 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] starting step: (1/1) ...persplatform/retainnarrow
2015-02-10 16:16:14,292 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:14,314 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] submitted hadoop job: job_local_0027
2015-02-10 16:16:14,314 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] tracking url: http://localhost:8080/
2015-02-10 16:16:14,317 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@21c17f5a
2015-02-10 16:16:14,318 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt
2015-02-10 16:16:14,319 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 0
2015-02-10 16:16:14,322 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:14,322 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:14,328 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt"]
2015-02-10 16:16:14,328 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['num']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/retainnarrow"]
2015-02-10 16:16:14,330 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0027_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:14,331 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:14,332 INFO  mapred.Task (Task.java:commit(1011)) - Task attempt_local_0027_m_000000_0 is allowed to commit now
2015-02-10 16:16:14,335 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0027_m_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/retainnarrow
2015-02-10 16:16:14,335 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt:0+19
2015-02-10 16:16:14,335 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0027_m_000000_0' done.
2015-02-10 16:16:14,346 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/retainnarrow/_temporary
2015-02-10 16:16:14,354 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:14,356 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/retainnarrow
2015-02-10 16:16:14,366 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:14,366 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:14,374 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [shape] starting
2015-02-10 16:16:14,375 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [shape]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt"]
2015-02-10 16:16:14,375 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [shape]  sink: Hfs["TextLine[['item']->['char', 'item']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/renamenarrow"]
2015-02-10 16:16:14,375 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [shape]  parallel execution is enabled: false
2015-02-10 16:16:14,375 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [shape]  starting jobs: 1
2015-02-10 16:16:14,375 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [shape]  allocating threads: 1
2015-02-10 16:16:14,376 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] starting step: (1/1) ...persplatform/renamenarrow
2015-02-10 16:16:14,384 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:14,404 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] submitted hadoop job: job_local_0028
2015-02-10 16:16:14,404 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] tracking url: http://localhost:8080/
2015-02-10 16:16:14,407 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@5ce33b57
2015-02-10 16:16:14,408 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt
2015-02-10 16:16:14,409 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 0
2015-02-10 16:16:14,411 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:14,412 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:14,415 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt"]
2015-02-10 16:16:14,415 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['item']->['char', 'item']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/renamenarrow"]
2015-02-10 16:16:14,417 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0028_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:14,418 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:14,418 INFO  mapred.Task (Task.java:commit(1011)) - Task attempt_local_0028_m_000000_0 is allowed to commit now
2015-02-10 16:16:14,420 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0028_m_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/renamenarrow
2015-02-10 16:16:14,421 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt:0+19
2015-02-10 16:16:14,421 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0028_m_000000_0' done.
2015-02-10 16:16:14,425 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/renamenarrow/_temporary
2015-02-10 16:16:14,433 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:14,435 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/renamenarrow
2015-02-10 16:16:14,448 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:14,449 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:14,460 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [average] starting
2015-02-10 16:16:14,460 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [average]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:14,461 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [average]  sink: Hfs["TextDelimited[['char', 'average']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/averagenull"]
2015-02-10 16:16:14,461 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [average]  parallel execution is enabled: false
2015-02-10 16:16:14,461 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [average]  starting jobs: 1
2015-02-10 16:16:14,461 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [average]  allocating threads: 1
2015-02-10 16:16:14,462 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [average] starting step: (1/1) ...lpersplatform/averagenull
2015-02-10 16:16:14,469 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:14,490 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [average] submitted hadoop job: job_local_0029
2015-02-10 16:16:14,490 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [average] tracking url: http://localhost:8080/
2015-02-10 16:16:14,493 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@61fba036
2015-02-10 16:16:14,494 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:14,495 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:14,496 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:14,637 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:14,637 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:14,638 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:14,639 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:14,645 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:14,645 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(average)[by:[{1}:'char']]
2015-02-10 16:16:14,646 INFO  assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:14,649 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:14,650 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 288, total: 589, max: 672
2015-02-10 16:16:14,651 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:14,651 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 288, total: 589, max: 672
2015-02-10 16:16:14,652 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:14,652 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 288, total: 589, max: 672
2015-02-10 16:16:14,652 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:14,653 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 288, total: 589, max: 672
2015-02-10 16:16:14,653 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:14,656 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:14,657 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0029_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:14,658 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:14,659 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0029_m_000000_0' done.
2015-02-10 16:16:14,662 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@5bb7b7a3
2015-02-10 16:16:14,662 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:14,663 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:14,664 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 200 bytes
2015-02-10 16:16:14,664 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:14,665 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:14,665 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:14,670 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(average)[by:[{1}:'char']]
2015-02-10 16:16:14,670 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'average']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/averagenull"]
2015-02-10 16:16:14,675 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0029_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:14,676 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:14,677 INFO  mapred.Task (Task.java:commit(1011)) - Task attempt_local_0029_r_000000_0 is allowed to commit now
2015-02-10 16:16:14,679 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0029_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/averagenull
2015-02-10 16:16:14,679 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:14,680 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0029_r_000000_0' done.
2015-02-10 16:16:14,688 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/averagenull/_temporary
2015-02-10 16:16:14,696 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:14,706 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:14,708 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/averagenull
2015-02-10 16:16:14,717 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:14,717 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:14,726 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [coerce] starting
2015-02-10 16:16:14,726 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [coerce]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt"]
2015-02-10 16:16:14,726 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [coerce]  sink: Hfs["TextLine[['line']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/coerce"]
2015-02-10 16:16:14,726 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [coerce]  parallel execution is enabled: false
2015-02-10 16:16:14,726 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [coerce]  starting jobs: 1
2015-02-10 16:16:14,727 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [coerce]  allocating threads: 1
2015-02-10 16:16:14,727 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [coerce] starting step: (1/1) ...blyhelpersplatform/coerce
2015-02-10 16:16:14,736 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:14,759 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [coerce] submitted hadoop job: job_local_0030
2015-02-10 16:16:14,759 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [coerce] tracking url: http://localhost:8080/
2015-02-10 16:16:14,761 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@296157ec
2015-02-10 16:16:14,763 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt
2015-02-10 16:16:14,764 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 0
2015-02-10 16:16:14,766 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:14,766 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:14,770 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt"]
2015-02-10 16:16:14,770 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['line']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/coerce"]
2015-02-10 16:16:14,772 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0030_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:14,772 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:14,773 INFO  mapred.Task (Task.java:commit(1011)) - Task attempt_local_0030_m_000000_0 is allowed to commit now
2015-02-10 16:16:14,775 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0030_m_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/coerce
2015-02-10 16:16:14,775 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt:0+19
2015-02-10 16:16:14,776 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0030_m_000000_0' done.
2015-02-10 16:16:14,780 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/coerce/_temporary
2015-02-10 16:16:14,789 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:14,790 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/coerce
2015-02-10 16:16:14,801 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:14,801 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:14,811 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [first] starting
2015-02-10 16:16:14,811 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [first]  source: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs+rhs-cross-rev.txt"]
2015-02-10 16:16:14,811 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [first]  sink: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/firstnfieldswithoutcomparator"]
2015-02-10 16:16:14,812 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [first]  parallel execution is enabled: false
2015-02-10 16:16:14,812 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [first]  starting jobs: 1
2015-02-10 16:16:14,812 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [first]  allocating threads: 1
2015-02-10 16:16:14,813 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [first] starting step: (1/1) ...tnfieldswithoutcomparator
2015-02-10 16:16:14,820 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:14,840 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [first] submitted hadoop job: job_local_0031
2015-02-10 16:16:14,841 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [first] tracking url: http://localhost:8080/
2015-02-10 16:16:14,843 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@15eb9b0d
2015-02-10 16:16:14,845 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs+rhs-cross-rev.txt
2015-02-10 16:16:14,846 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:14,846 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:14,863 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:14,863 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:14,865 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:14,865 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:14,870 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs+rhs-cross-rev.txt"]
2015-02-10 16:16:14,870 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(first)[by:[{1}:'num']]
2015-02-10 16:16:14,871 INFO  assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:14,873 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:14,874 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 160, total: 589, max: 672
2015-02-10 16:16:14,875 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:14,875 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 160, total: 589, max: 672
2015-02-10 16:16:14,876 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:14,878 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:14,880 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0031_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:14,881 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs+rhs-cross-rev.txt:0+221
2015-02-10 16:16:14,882 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0031_m_000000_0' done.
2015-02-10 16:16:14,887 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@37811015
2015-02-10 16:16:14,887 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:14,888 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:14,889 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 117 bytes
2015-02-10 16:16:14,889 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:14,890 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:14,890 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:14,894 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(first)[by:[{1}:'num']]
2015-02-10 16:16:14,895 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/firstnfieldswithoutcomparator"]
2015-02-10 16:16:14,899 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0031_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:14,900 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:14,901 INFO  mapred.Task (Task.java:commit(1011)) - Task attempt_local_0031_r_000000_0 is allowed to commit now
2015-02-10 16:16:14,903 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0031_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/firstnfieldswithoutcomparator
2015-02-10 16:16:14,903 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:14,904 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0031_r_000000_0' done.
2015-02-10 16:16:14,912 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/firstnfieldswithoutcomparator/_temporary
2015-02-10 16:16:14,921 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:14,922 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/firstnfieldswithoutcomparator
2015-02-10 16:16:14,937 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:14,937 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:14,984 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [count-lhs*source*count...] starting
2015-02-10 16:16:14,985 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [count-lhs*source*count...]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:14,985 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [count-lhs*source*count...]  sink: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/samesourcemergethreeway"]
2015-02-10 16:16:14,985 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [count-lhs*source*count...]  parallel execution is enabled: false
2015-02-10 16:16:14,985 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [count-lhs*source*count...]  starting jobs: 5
2015-02-10 16:16:14,986 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [count-lhs*source*count...]  allocating threads: 1
2015-02-10 16:16:14,986 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] starting step: (1/5)
2015-02-10 16:16:14,994 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:15,015 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] submitted hadoop job: job_local_0032
2015-02-10 16:16:15,015 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2015-02-10 16:16:15,018 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@7db94a3f
2015-02-10 16:16:15,019 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:15,020 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:15,021 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:15,047 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:15,048 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:15,049 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:15,049 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:15,055 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:15,055 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(source)[by:[{1}:'char']]
2015-02-10 16:16:15,056 INFO  assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:15,057 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:15,058 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 193, total: 590, max: 672
2015-02-10 16:16:15,059 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:15,059 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 193, total: 590, max: 672
2015-02-10 16:16:15,060 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:15,060 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 193, total: 590, max: 672
2015-02-10 16:16:15,061 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:15,061 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 193, total: 590, max: 672
2015-02-10 16:16:15,062 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:15,064 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:15,066 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0032_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:15,067 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:15,068 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0032_m_000000_0' done.
2015-02-10 16:16:15,071 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@634366f3
2015-02-10 16:16:15,072 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:15,073 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:15,074 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 119 bytes
2015-02-10 16:16:15,074 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:15,075 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:15,075 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:15,080 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(source)[by:[{1}:'char']]
2015-02-10 16:16:15,080 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: TempHfs["SequenceFile[['char', 'count']]"][7009949486/source/]
2015-02-10 16:16:15,085 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0032_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:15,086 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:15,087 INFO  mapred.Task (Task.java:commit(1011)) - Task attempt_local_0032_r_000000_0 is allowed to commit now
2015-02-10 16:16:15,089 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0032_r_000000_0' to file:/tmp/hadoop-teamcity/7009949486_source_27C0D93015D946EDB1795C39C6C70515
2015-02-10 16:16:15,089 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:15,090 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0032_r_000000_0' done.
2015-02-10 16:16:15,101 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] starting step: (3/5)
2015-02-10 16:16:15,109 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:15,131 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] submitted hadoop job: job_local_0033
2015-02-10 16:16:15,131 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2015-02-10 16:16:15,134 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@318790d7
2015-02-10 16:16:15,136 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/7009949486_source_27C0D93015D946EDB1795C39C6C70515/part-00000
2015-02-10 16:16:15,137 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:15,137 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:15,195 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:15,196 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:15,197 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:15,197 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:15,202 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][7009949486/source/]
2015-02-10 16:16:15,202 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(count-lhs)[by:[{1}:'char']]
2015-02-10 16:16:15,203 INFO  assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:15,204 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:15,204 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 85, total: 590, max: 672
2015-02-10 16:16:15,205 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:15,205 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 85, total: 590, max: 672
2015-02-10 16:16:15,206 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:15,208 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:15,209 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0033_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:15,210 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/tmp/hadoop-teamcity/7009949486_source_27C0D93015D946EDB1795C39C6C70515/part-00000:0+160
2015-02-10 16:16:15,211 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0033_m_000000_0' done.
2015-02-10 16:16:15,215 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@42d32028
2015-02-10 16:16:15,215 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:15,217 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:15,217 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 67 bytes
2015-02-10 16:16:15,218 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:15,219 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:15,219 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:15,224 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(count-lhs)[by:[{1}:'char']]
2015-02-10 16:16:15,224 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: TempHfs["SequenceFile[['char', 'count']]"][3596105809/count-lhs/]
2015-02-10 16:16:15,228 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0033_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:15,229 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:15,230 INFO  mapred.Task (Task.java:commit(1011)) - Task attempt_local_0033_r_000000_0 is allowed to commit now
2015-02-10 16:16:15,232 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0033_r_000000_0' to file:/tmp/hadoop-teamcity/3596105809_count_lhs_DBC15B14EFFD4F0C8C3FBDE19C4913D3
2015-02-10 16:16:15,232 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:15,233 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0033_r_000000_0' done.
2015-02-10 16:16:15,243 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] starting step: (4/5)
2015-02-10 16:16:15,254 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:15,281 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] submitted hadoop job: job_local_0034
2015-02-10 16:16:15,282 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2015-02-10 16:16:15,284 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@3c8fa832
2015-02-10 16:16:15,286 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/7009949486_source_27C0D93015D946EDB1795C39C6C70515/part-00000
2015-02-10 16:16:15,287 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:15,288 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:15,311 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:15,312 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:15,314 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:15,314 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:15,319 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][7009949486/source/]
2015-02-10 16:16:15,319 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(count-rhs)[by:[{1}:'char']]
2015-02-10 16:16:15,320 INFO  assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:15,321 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:15,322 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 193, total: 589, max: 672
2015-02-10 16:16:15,322 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:15,323 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 193, total: 589, max: 672
2015-02-10 16:16:15,323 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:15,325 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:15,327 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0034_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:15,328 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/tmp/hadoop-teamcity/7009949486_source_27C0D93015D946EDB1795C39C6C70515/part-00000:0+160
2015-02-10 16:16:15,329 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0034_m_000000_0' done.
2015-02-10 16:16:15,332 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@6bfa2e2e
2015-02-10 16:16:15,332 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:15,334 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:15,334 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 67 bytes
2015-02-10 16:16:15,335 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:15,336 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:15,336 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:15,340 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(count-rhs)[by:[{1}:'char']]
2015-02-10 16:16:15,341 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: TempHfs["SequenceFile[['char', 'count']]"][4238742939/count-rhs/]
2015-02-10 16:16:15,345 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0034_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:15,345 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:15,346 INFO  mapred.Task (Task.java:commit(1011)) - Task attempt_local_0034_r_000000_0 is allowed to commit now
2015-02-10 16:16:15,348 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0034_r_000000_0' to file:/tmp/hadoop-teamcity/4238742939_count_rhs_75DCECF745E44926BF0EB3B228E69D80
2015-02-10 16:16:15,349 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:15,350 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0034_r_000000_0' done.
2015-02-10 16:16:15,355 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] starting step: (2/5)
2015-02-10 16:16:15,364 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:15,365 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:15,386 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] submitted hadoop job: job_local_0035
2015-02-10 16:16:15,386 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2015-02-10 16:16:15,389 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@299b78d4
2015-02-10 16:16:15,390 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/4238742939_count_rhs_75DCECF745E44926BF0EB3B228E69D80/part-00000
2015-02-10 16:16:15,392 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:15,392 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:15,410 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:15,410 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:15,413 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:15,413 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:15,419 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][4238742939/count-rhs/]
2015-02-10 16:16:15,419 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: CoGroup(source*count-rhs)[by: source:[{1}:'char'] count-rhs:[{1}:'char']]
2015-02-10 16:16:15,421 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:15,423 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:15,425 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0035_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:15,426 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/tmp/hadoop-teamcity/4238742939_count_rhs_75DCECF745E44926BF0EB3B228E69D80/part-00000:0+160
2015-02-10 16:16:15,427 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0035_m_000000_0' done.
2015-02-10 16:16:15,428 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@334ecfe8
2015-02-10 16:16:15,429 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/7009949486_source_27C0D93015D946EDB1795C39C6C70515/part-00000
2015-02-10 16:16:15,431 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:15,431 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:15,455 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:15,455 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:15,457 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:15,457 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:15,462 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][7009949486/source/]
2015-02-10 16:16:15,462 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: CoGroup(source*count-rhs)[by: source:[{1}:'char'] count-rhs:[{1}:'char']]
2015-02-10 16:16:15,464 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:15,466 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:15,467 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0035_m_000001_0 is done. And is in the process of commiting
2015-02-10 16:16:15,468 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/tmp/hadoop-teamcity/7009949486_source_27C0D93015D946EDB1795C39C6C70515/part-00000:0+160
2015-02-10 16:16:15,469 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0035_m_000001_0' done.
2015-02-10 16:16:15,474 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@351037b
2015-02-10 16:16:15,475 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:15,476 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 2 sorted segments
2015-02-10 16:16:15,477 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 2 segments left of total size: 154 bytes
2015-02-10 16:16:15,477 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:15,478 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:15,479 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:15,483 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: CoGroup(source*count-rhs)[by: source:[{1}:'char'] count-rhs:[{1}:'char']]
2015-02-10 16:16:15,484 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: TempHfs["SequenceFile[['char', 'num', 'char2', 'count']]"][933824959/source_count-rhs/]
2015-02-10 16:16:15,493 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-02-10 16:16:15,494 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2015-02-10 16:16:15,501 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0035_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:15,501 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:15,502 INFO  mapred.Task (Task.java:commit(1011)) - Task attempt_local_0035_r_000000_0 is allowed to commit now
2015-02-10 16:16:15,504 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0035_r_000000_0' to file:/tmp/hadoop-teamcity/933824959_source_count_rhs_CAAB53DF86BD44DEA39A36304D82D231
2015-02-10 16:16:15,505 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:15,505 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0035_r_000000_0' done.
2015-02-10 16:16:15,509 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] starting step: (5/5) ...m/samesourcemergethreeway
2015-02-10 16:16:15,518 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:15,519 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:15,539 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] submitted hadoop job: job_local_0036
2015-02-10 16:16:15,540 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2015-02-10 16:16:15,542 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@6bc947
2015-02-10 16:16:15,544 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/933824959_source_count_rhs_CAAB53DF86BD44DEA39A36304D82D231/part-00000
2015-02-10 16:16:15,545 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:15,545 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:15,562 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:15,563 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:15,564 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:15,564 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:15,571 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: TempHfs["SequenceFile[['char', 'num', 'char2', 'count']]"][933824959/source_count-rhs/]
2015-02-10 16:16:15,571 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: CoGroup(count-lhs*source*count-rhs)[by: count-lhs:[{1}:'char'] source*count-rhs:[{1}:'char']]
2015-02-10 16:16:15,572 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:15,574 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:15,576 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0036_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:15,577 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/tmp/hadoop-teamcity/933824959_source_count_rhs_CAAB53DF86BD44DEA39A36304D82D231/part-00000:0+200
2015-02-10 16:16:15,578 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0036_m_000000_0' done.
2015-02-10 16:16:15,579 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@7adc28b2
2015-02-10 16:16:15,582 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/3596105809_count_lhs_DBC15B14EFFD4F0C8C3FBDE19C4913D3/part-00000
2015-02-10 16:16:15,584 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:15,584 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:15,607 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:15,608 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:15,609 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:15,609 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:15,616 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][3596105809/count-lhs/]
2015-02-10 16:16:15,617 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: CoGroup(count-lhs*source*count-rhs)[by: count-lhs:[{1}:'char'] source*count-rhs:[{1}:'char']]
2015-02-10 16:16:15,619 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:15,622 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:15,623 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0036_m_000001_0 is done. And is in the process of commiting
2015-02-10 16:16:15,624 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/tmp/hadoop-teamcity/3596105809_count_lhs_DBC15B14EFFD4F0C8C3FBDE19C4913D3/part-00000:0+160
2015-02-10 16:16:15,625 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0036_m_000001_0' done.
2015-02-10 16:16:15,630 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@311552cd
2015-02-10 16:16:15,631 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:15,632 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 2 sorted segments
2015-02-10 16:16:15,633 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 2 segments left of total size: 194 bytes
2015-02-10 16:16:15,633 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:15,634 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:15,634 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:15,640 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: CoGroup(count-lhs*source*count-rhs)[by: count-lhs:[{1}:'char'] source*count-rhs:[{1}:'char']]
2015-02-10 16:16:15,640 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/samesourcemergethreeway"]
2015-02-10 16:16:15,643 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-02-10 16:16:15,643 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2015-02-10 16:16:15,646 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0036_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:15,646 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:15,647 INFO  mapred.Task (Task.java:commit(1011)) - Task attempt_local_0036_r_000000_0 is allowed to commit now
2015-02-10 16:16:15,649 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0036_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/samesourcemergethreeway
2015-02-10 16:16:15,649 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:15,650 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0036_r_000000_0' done.
2015-02-10 16:16:15,664 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/samesourcemergethreeway/_temporary
2015-02-10 16:16:15,672 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:15,681 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:15,683 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/samesourcemergethreeway
2015-02-10 16:16:15,696 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:15,697 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:15,712 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs+rhs] starting
2015-02-10 16:16:15,712 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs+rhs]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt"]
2015-02-10 16:16:15,713 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs+rhs]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:15,713 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs+rhs]  sink: Hfs["TextLine[['item']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/uniquemerge-nondeterministic"]
2015-02-10 16:16:15,713 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs+rhs]  parallel execution is enabled: false
2015-02-10 16:16:15,713 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs+rhs]  starting jobs: 1
2015-02-10 16:16:15,713 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs+rhs]  allocating threads: 1
2015-02-10 16:16:15,714 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs+rhs] starting step: (1/1) ...quemerge-nondeterministic
2015-02-10 16:16:15,722 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:15,723 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:15,745 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs+rhs] submitted hadoop job: job_local_0037
2015-02-10 16:16:15,745 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs+rhs] tracking url: http://localhost:8080/
2015-02-10 16:16:15,748 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@515a3dac
2015-02-10 16:16:15,749 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:15,751 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:15,751 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:15,772 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:15,772 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:15,774 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:15,774 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:15,779 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:15,779 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(lhs+rhs)[by: lhs:[{1}:'num'] rhs:[{1}:'num']]
2015-02-10 16:16:15,785 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:15,787 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:15,788 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0037_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:15,790 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:15,790 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0037_m_000000_0' done.
2015-02-10 16:16:15,792 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@299264e3
2015-02-10 16:16:15,794 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt
2015-02-10 16:16:15,795 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:15,796 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:15,820 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:15,821 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:15,822 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:15,822 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:15,827 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt"]
2015-02-10 16:16:15,827 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(lhs+rhs)[by: lhs:[{1}:'num'] rhs:[{1}:'num']]
2015-02-10 16:16:15,830 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:15,832 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:15,834 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0037_m_000001_0 is done. And is in the process of commiting
2015-02-10 16:16:15,835 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt:0+51
2015-02-10 16:16:15,836 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0037_m_000001_0' done.
2015-02-10 16:16:15,841 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@2bc674d8
2015-02-10 16:16:15,842 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:15,843 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 2 sorted segments
2015-02-10 16:16:15,844 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 2 segments left of total size: 174 bytes
2015-02-10 16:16:15,844 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:15,845 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:15,846 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:15,850 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(lhs+rhs)[by: lhs:[{1}:'num'] rhs:[{1}:'num']]
2015-02-10 16:16:15,851 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['item']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/uniquemerge-nondeterministic"]
2015-02-10 16:16:15,857 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0037_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:15,858 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:15,859 INFO  mapred.Task (Task.java:commit(1011)) - Task attempt_local_0037_r_000000_0 is allowed to commit now
2015-02-10 16:16:15,861 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0037_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/uniquemerge-nondeterministic
2015-02-10 16:16:15,862 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:15,863 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0037_r_000000_0' done.
2015-02-10 16:16:15,873 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/uniquemerge-nondeterministic/_temporary
2015-02-10 16:16:15,882 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:15,883 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/uniquemerge-nondeterministic
2015-02-10 16:16:15,893 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:15,894 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:15,903 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [shape] starting
2015-02-10 16:16:15,903 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [shape]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:15,903 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [shape]  sink: Hfs["TextLine[['item']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/unique"]
2015-02-10 16:16:15,904 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [shape]  parallel execution is enabled: false
2015-02-10 16:16:15,904 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [shape]  starting jobs: 1
2015-02-10 16:16:15,904 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [shape]  allocating threads: 1
2015-02-10 16:16:15,905 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] starting step: (1/1) ...blyhelpersplatform/unique
2015-02-10 16:16:15,913 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:15,933 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] submitted hadoop job: job_local_0038
2015-02-10 16:16:15,933 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] tracking url: http://localhost:8080/
2015-02-10 16:16:15,936 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@6ea27cbe
2015-02-10 16:16:15,937 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:15,938 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:15,939 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:15,956 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:15,956 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:15,957 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:15,957 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:15,961 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:15,961 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(shape)[by:[{1}:'num']]
2015-02-10 16:16:15,964 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:15,966 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:15,967 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0038_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:15,968 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:15,969 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0038_m_000000_0' done.
2015-02-10 16:16:15,972 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@6cb36431
2015-02-10 16:16:15,972 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:15,973 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:15,975 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 87 bytes
2015-02-10 16:16:15,975 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:15,976 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:15,976 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:15,981 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(shape)[by:[{1}:'num']]
2015-02-10 16:16:15,981 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['item']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/unique"]
2015-02-10 16:16:15,986 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0038_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:15,987 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:15,988 INFO  mapred.Task (Task.java:commit(1011)) - Task attempt_local_0038_r_000000_0 is allowed to commit now
2015-02-10 16:16:15,990 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0038_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/unique
2015-02-10 16:16:15,991 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:15,992 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0038_r_000000_0' done.
2015-02-10 16:16:15,995 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/unique/_temporary
2015-02-10 16:16:16,005 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:16,007 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/unique
2015-02-10 16:16:16,022 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:16,023 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:16,036 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [count] starting
2015-02-10 16:16:16,036 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [count]  source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:16,037 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [count]  sink: Hfs["TextDelimited[['notnull', 'null']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/countnullnotnull"]
2015-02-10 16:16:16,037 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [count]  parallel execution is enabled: false
2015-02-10 16:16:16,037 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [count]  starting jobs: 1
2015-02-10 16:16:16,037 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [count]  allocating threads: 1
2015-02-10 16:16:16,039 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] starting step: (1/1) ...platform/countnullnotnull
2015-02-10 16:16:16,048 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:16,075 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] submitted hadoop job: job_local_0039
2015-02-10 16:16:16,076 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] tracking url: http://localhost:8080/
2015-02-10 16:16:16,079 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@7685dfcf
2015-02-10 16:16:16,080 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:16,082 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:16,082 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:16,106 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:16,106 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:16,108 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:16,108 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:16,114 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:16,114 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(count)[by:[{?}:NONE]]
2015-02-10 16:16:16,115 INFO  assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:16,120 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:16,122 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:16,124 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0039_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:16,125 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:16,125 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0039_m_000000_0' done.
2015-02-10 16:16:16,128 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@5abbfa4c
2015-02-10 16:16:16,129 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:16,130 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:16,131 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 10 bytes
2015-02-10 16:16:16,131 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:16,132 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:16,132 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:16,138 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(count)[by:[{?}:NONE]]
2015-02-10 16:16:16,138 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['notnull', 'null']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/countnullnotnull"]
2015-02-10 16:16:16,142 INFO  mapred.Task (Task.java:done(858)) - Task:attempt_local_0039_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:16,142 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - 
2015-02-10 16:16:16,143 INFO  mapred.Task (Task.java:commit(1011)) - Task attempt_local_0039_r_000000_0 is allowed to commit now
2015-02-10 16:16:16,145 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0039_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/countnullnotnull
2015-02-10 16:16:16,146 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:16,147 INFO  mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0039_r_000000_0' done.
2015-02-10 16:16:16,149 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/countnullnotnull/_temporary
2015-02-10 16:16:16,158 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:16,166 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:16,168 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/countnullnotnull