2015-02-10 16:16:03,265 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(187)) - found 1 test platforms from classpath
2015-02-10 16:16:03,312 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(237)) - installing platform: hadoop
2015-02-10 16:16:03,313 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(238)) - running test: cascading.pipe.assembly.AssemblyHelpersPlatformTest
2015-02-10 16:16:03,355 INFO hadoop.HadoopPlatform (HadoopPlatform.java:setUp(112)) - not using cluster
2015-02-10 16:16:04,051 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:04,054 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:04,067 INFO property.AppProps (AppProps.java:getAppID(169)) - using app.id: 46316047E0754E8698EF7825B113A2FE
2015-02-10 16:16:04,355 INFO util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 2.6.3
2015-02-10 16:16:04,359 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [name] starting
2015-02-10 16:16:04,360 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt"]
2015-02-10 16:16:04,361 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:04,362 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [name] sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/multimerge+false"]
2015-02-10 16:16:04,363 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [name] parallel execution is enabled: false
2015-02-10 16:16:04,364 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [name] starting jobs: 1
2015-02-10 16:16:04,364 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [name] allocating threads: 1
2015-02-10 16:16:04,366 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [name] starting step: (1/1) ...platform/multimerge+false
2015-02-10 16:16:04,420 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(52)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2015-02-10 16:16:04,496 WARN snappy.LoadSnappy (LoadSnappy.java:<clinit>(46)) - Snappy native library not loaded
2015-02-10 16:16:04,500 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:04,510 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:04,752 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [name] submitted hadoop job: job_local_0001
2015-02-10 16:16:04,754 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [name] tracking url: http://localhost:8080/
2015-02-10 16:16:04,826 INFO util.ProcessTree (ProcessTree.java:isSetsidSupported(63)) - setsid exited with exit code 0
2015-02-10 16:16:04,835 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@1f2be27
2015-02-10 16:16:04,843 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:04,851 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:04,860 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:05,021 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:05,021 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:05,050 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:05,051 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:05,124 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:05,125 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2015-02-10 16:16:05,131 INFO assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:05,145 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:05,146 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 79, total: 197, max: 672
2015-02-10 16:16:05,147 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 29% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:05,149 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:05,150 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 79, total: 197, max: 672
2015-02-10 16:16:05,151 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 29% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:05,152 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:05,153 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 79, total: 197, max: 672
2015-02-10 16:16:05,154 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 29% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:05,155 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:05,156 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 79, total: 197, max: 672
2015-02-10 16:16:05,157 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 29% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:05,158 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:05,170 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:05,173 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0001_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:05,178 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:05,179 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0001_m_000000_0' done.
2015-02-10 16:16:05,183 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@4e3c35fd
2015-02-10 16:16:05,185 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt
2015-02-10 16:16:05,188 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:05,189 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:05,328 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:05,329 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:05,333 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:05,334 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:05,361 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt"]
2015-02-10 16:16:05,362 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2015-02-10 16:16:05,365 INFO assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:05,476 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:05,477 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 91, total: 292, max: 672
2015-02-10 16:16:05,477 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 43% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:05,480 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:05,480 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 91, total: 292, max: 672
2015-02-10 16:16:05,481 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 43% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:05,483 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:05,484 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 91, total: 292, max: 672
2015-02-10 16:16:05,485 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 43% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:05,486 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:05,487 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 90, total: 292, max: 672
2015-02-10 16:16:05,488 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 43% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:05,489 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:05,494 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:05,497 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0001_m_000001_0 is done. And is in the process of commiting
2015-02-10 16:16:05,499 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt:0+51
2015-02-10 16:16:05,501 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0001_m_000001_0' done.
2015-02-10 16:16:05,518 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@63f9f0f2
2015-02-10 16:16:05,518 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:05,527 INFO mapred.Merger (Merger.java:merge(390)) - Merging 2 sorted segments
2015-02-10 16:16:05,535 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 2 segments left of total size: 472 bytes
2015-02-10 16:16:05,536 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:05,540 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:05,541 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:05,568 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2015-02-10 16:16:05,569 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/multimerge+false"]
2015-02-10 16:16:05,596 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0001_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:05,598 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:05,599 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local_0001_r_000000_0 is allowed to commit now
2015-02-10 16:16:05,604 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0001_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/multimerge+false
2015-02-10 16:16:05,605 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:05,606 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0001_r_000000_0' done.
2015-02-10 16:16:05,624 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/multimerge+false/_temporary
2015-02-10 16:16:05,648 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:05,673 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:05,676 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/multimerge+false
2015-02-10 16:16:05,707 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:05,708 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:05,743 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [max] starting
2015-02-10 16:16:05,744 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [max] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:05,745 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [max] sink: Hfs["TextDelimited[['num', 'min']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/minbystring"]
2015-02-10 16:16:05,745 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [max] parallel execution is enabled: false
2015-02-10 16:16:05,746 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [max] starting jobs: 1
2015-02-10 16:16:05,747 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [max] allocating threads: 1
2015-02-10 16:16:05,748 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [max] starting step: (1/1) ...lpersplatform/minbystring
2015-02-10 16:16:05,764 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:05,863 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [max] submitted hadoop job: job_local_0002
2015-02-10 16:16:05,863 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [max] tracking url: http://localhost:8080/
2015-02-10 16:16:05,867 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@65cb048e
2015-02-10 16:16:05,869 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:05,871 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:05,872 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:06,025 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:06,025 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:06,028 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:06,028 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:06,042 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:06,042 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(max)[by:[{1}:'num']]
2015-02-10 16:16:06,043 INFO assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:06,045 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:06,045 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 70, total: 387, max: 672
2015-02-10 16:16:06,045 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 57% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:06,046 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:06,047 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 70, total: 387, max: 672
2015-02-10 16:16:06,047 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 57% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:06,048 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:06,051 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:06,054 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0002_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:06,055 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:06,056 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0002_m_000000_0' done.
2015-02-10 16:16:06,061 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@20edbca8
2015-02-10 16:16:06,062 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:06,063 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:06,064 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 87 bytes
2015-02-10 16:16:06,064 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:06,065 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:06,066 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:06,078 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(max)[by:[{1}:'num']]
2015-02-10 16:16:06,079 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['num', 'min']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/minbystring"]
2015-02-10 16:16:06,087 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0002_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:06,088 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:06,089 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local_0002_r_000000_0 is allowed to commit now
2015-02-10 16:16:06,093 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0002_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/minbystring
2015-02-10 16:16:06,094 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:06,095 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0002_r_000000_0' done.
2015-02-10 16:16:06,106 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/minbystring/_temporary
2015-02-10 16:16:06,129 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:06,158 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:06,161 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/minbystring
2015-02-10 16:16:06,191 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:06,192 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:06,233 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [average-lhs+average-rhs] starting
2015-02-10 16:16:06,234 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [average-lhs+average-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt"]
2015-02-10 16:16:06,235 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [average-lhs+average-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:06,236 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [average-lhs+average-rhs] sink: Hfs["TextDelimited[['char', 'average']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/mergeaverage"]
2015-02-10 16:16:06,236 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [average-lhs+average-rhs] parallel execution is enabled: false
2015-02-10 16:16:06,237 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [average-lhs+average-rhs] starting jobs: 1
2015-02-10 16:16:06,237 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [average-lhs+average-rhs] allocating threads: 1
2015-02-10 16:16:06,239 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [average-lhs+average-rhs] starting step: (1/1) ...persplatform/mergeaverage
2015-02-10 16:16:06,254 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:06,256 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:06,309 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [average-lhs+average-rhs] submitted hadoop job: job_local_0003
2015-02-10 16:16:06,310 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [average-lhs+average-rhs] tracking url: http://localhost:8080/
2015-02-10 16:16:06,314 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@5694fe42
2015-02-10 16:16:06,316 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:06,318 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:06,318 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:06,467 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:06,468 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:06,469 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:06,469 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:06,485 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:06,486 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(average-lhs+average-rhs)[by: average-lhs:[{1}:'char'] average-rhs:[{1}:'char']]
2015-02-10 16:16:06,486 INFO assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:06,488 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:06,488 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 79, total: 482, max: 672
2015-02-10 16:16:06,489 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:06,490 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:06,490 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 79, total: 482, max: 672
2015-02-10 16:16:06,490 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:06,491 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:06,492 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 79, total: 482, max: 672
2015-02-10 16:16:06,492 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:06,493 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:06,493 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 79, total: 482, max: 672
2015-02-10 16:16:06,493 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:06,494 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:06,497 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:06,500 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0003_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:06,501 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:06,502 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0003_m_000000_0' done.
2015-02-10 16:16:06,504 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@57c501f7
2015-02-10 16:16:06,507 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt
2015-02-10 16:16:06,508 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:06,509 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:06,658 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:06,658 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:06,660 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:06,660 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:06,675 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt"]
2015-02-10 16:16:06,676 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(average-lhs+average-rhs)[by: average-lhs:[{1}:'char'] average-rhs:[{1}:'char']]
2015-02-10 16:16:06,676 INFO assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:06,681 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:06,681 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 30, total: 535, max: 672
2015-02-10 16:16:06,681 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 79% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:06,683 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:06,683 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 29, total: 535, max: 672
2015-02-10 16:16:06,683 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 79% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:06,684 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:06,685 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 29, total: 535, max: 672
2015-02-10 16:16:06,685 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 79% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:06,686 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:06,686 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 29, total: 535, max: 672
2015-02-10 16:16:06,687 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 79% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:06,687 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:06,713 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:06,715 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0003_m_000001_0 is done. And is in the process of commiting
2015-02-10 16:16:06,716 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt:0+51
2015-02-10 16:16:06,717 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0003_m_000001_0' done.
2015-02-10 16:16:06,726 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@576eeb9
2015-02-10 16:16:06,727 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:06,729 INFO mapred.Merger (Merger.java:merge(390)) - Merging 2 sorted segments
2015-02-10 16:16:06,729 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 2 segments left of total size: 400 bytes
2015-02-10 16:16:06,730 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:06,731 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:06,731 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:06,744 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(average-lhs+average-rhs)[by: average-lhs:[{1}:'char'] average-rhs:[{1}:'char']]
2015-02-10 16:16:06,745 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'average']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/mergeaverage"]
2015-02-10 16:16:06,754 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0003_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:06,754 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:06,756 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local_0003_r_000000_0 is allowed to commit now
2015-02-10 16:16:06,759 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0003_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/mergeaverage
2015-02-10 16:16:06,760 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:06,761 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0003_r_000000_0' done.
2015-02-10 16:16:06,776 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/mergeaverage/_temporary
2015-02-10 16:16:06,789 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:06,820 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:06,822 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/mergeaverage
2015-02-10 16:16:06,841 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:06,842 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:06,866 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [shape] starting
2015-02-10 16:16:06,867 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt"]
2015-02-10 16:16:06,868 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [shape] sink: Hfs["TextLine[['line']->['item', 'element']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/renameall"]
2015-02-10 16:16:06,868 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [shape] parallel execution is enabled: false
2015-02-10 16:16:06,868 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [shape] starting jobs: 1
2015-02-10 16:16:06,868 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [shape] allocating threads: 1
2015-02-10 16:16:06,869 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] starting step: (1/1) ...helpersplatform/renameall
2015-02-10 16:16:06,884 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:06,925 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] submitted hadoop job: job_local_0004
2015-02-10 16:16:06,926 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] tracking url: http://localhost:8080/
2015-02-10 16:16:06,930 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@14cef147
2015-02-10 16:16:06,932 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt
2015-02-10 16:16:06,933 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 0
2015-02-10 16:16:06,939 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:06,939 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:06,947 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt"]
2015-02-10 16:16:06,947 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['line']->['item', 'element']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/renameall"]
2015-02-10 16:16:06,951 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0004_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:06,951 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:06,952 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local_0004_m_000000_0 is allowed to commit now
2015-02-10 16:16:06,956 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0004_m_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/renameall
2015-02-10 16:16:06,956 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt:0+19
2015-02-10 16:16:06,957 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0004_m_000000_0' done.
2015-02-10 16:16:06,968 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/renameall/_temporary
2015-02-10 16:16:06,980 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:06,982 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/renameall
2015-02-10 16:16:07,001 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:07,002 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:07,053 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] starting
2015-02-10 16:16:07,054 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:07,054 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] sink: Hfs["TextDelimited[['count', 'count2']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/countcount"]
2015-02-10 16:16:07,054 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] parallel execution is enabled: false
2015-02-10 16:16:07,055 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] starting jobs: 2
2015-02-10 16:16:07,055 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] allocating threads: 1
2015-02-10 16:16:07,056 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] starting step: (1/2)
2015-02-10 16:16:07,131 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:07,175 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] submitted hadoop job: job_local_0005
2015-02-10 16:16:07,177 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] tracking url: http://localhost:8080/
2015-02-10 16:16:07,179 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@7991ba7
2015-02-10 16:16:07,181 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:07,182 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:07,183 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:07,543 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:07,546 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:07,548 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:07,548 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:07,562 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:07,563 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(count)[by:[{1}:'char']]
2015-02-10 16:16:07,564 INFO assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:07,566 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:07,567 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 77, total: 181, max: 672
2015-02-10 16:16:07,568 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 26% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:07,569 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:07,570 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 77, total: 181, max: 672
2015-02-10 16:16:07,570 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 26% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:07,571 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:07,572 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 77, total: 181, max: 672
2015-02-10 16:16:07,573 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 26% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:07,574 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:07,574 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 77, total: 181, max: 672
2015-02-10 16:16:07,575 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 26% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:07,576 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:07,579 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:07,582 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0005_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:07,584 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:07,585 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0005_m_000000_0' done.
2015-02-10 16:16:07,590 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@60396c7
2015-02-10 16:16:07,590 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:07,593 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:07,594 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 119 bytes
2015-02-10 16:16:07,594 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:07,596 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:07,596 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:07,607 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(count)[by:[{1}:'char']]
2015-02-10 16:16:07,608 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: TempHfs["SequenceFile[['count', 'count2']]"][8010798447/count/]
2015-02-10 16:16:07,620 INFO assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:07,622 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:07,623 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 75, total: 181, max: 672
2015-02-10 16:16:07,624 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 26% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:07,626 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0005_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:07,627 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:07,628 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local_0005_r_000000_0 is allowed to commit now
2015-02-10 16:16:07,631 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0005_r_000000_0' to file:/tmp/hadoop-teamcity/8010798447_count_0C91A42083404A0EA893942D828E4592
2015-02-10 16:16:07,632 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:07,633 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0005_r_000000_0' done.
2015-02-10 16:16:07,644 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] starting step: (2/2) ...elpersplatform/countcount
2015-02-10 16:16:07,658 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:07,697 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] submitted hadoop job: job_local_0006
2015-02-10 16:16:07,698 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] tracking url: http://localhost:8080/
2015-02-10 16:16:07,701 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@70b125bd
2015-02-10 16:16:07,703 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/8010798447_count_0C91A42083404A0EA893942D828E4592/part-00000
2015-02-10 16:16:07,710 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:07,710 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:07,850 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:07,851 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:07,853 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:07,853 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:07,865 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: TempHfs["SequenceFile[['count', 'count2']]"][8010798447/count/]
2015-02-10 16:16:07,865 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(count)[by:[{1}:'count']]
2015-02-10 16:16:07,867 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:07,869 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:07,871 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0006_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:07,873 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/tmp/hadoop-teamcity/8010798447_count_0C91A42083404A0EA893942D828E4592/part-00000:0+112
2015-02-10 16:16:07,874 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0006_m_000000_0' done.
2015-02-10 16:16:07,878 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@762d4c7e
2015-02-10 16:16:07,878 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:07,879 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:07,880 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 29 bytes
2015-02-10 16:16:07,880 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:07,881 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:07,881 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:07,892 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(count)[by:[{1}:'count']]
2015-02-10 16:16:07,893 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['count', 'count2']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/countcount"]
2015-02-10 16:16:07,901 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0006_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:07,902 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:07,903 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local_0006_r_000000_0 is allowed to commit now
2015-02-10 16:16:07,906 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0006_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/countcount
2015-02-10 16:16:07,906 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:07,907 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0006_r_000000_0' done.
2015-02-10 16:16:07,922 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/countcount/_temporary
2015-02-10 16:16:07,934 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:07,946 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:07,948 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/countcount
2015-02-10 16:16:07,967 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:07,968 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:08,000 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count-lhs+count-rhs] starting
2015-02-10 16:16:08,009 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count-lhs+count-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt"]
2015-02-10 16:16:08,011 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count-lhs+count-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:08,012 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count-lhs+count-rhs] sink: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/mergecount"]
2015-02-10 16:16:08,013 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count-lhs+count-rhs] parallel execution is enabled: false
2015-02-10 16:16:08,013 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count-lhs+count-rhs] starting jobs: 1
2015-02-10 16:16:08,013 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count-lhs+count-rhs] allocating threads: 1
2015-02-10 16:16:08,014 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs+count-rhs] starting step: (1/1) ...elpersplatform/mergecount
2015-02-10 16:16:08,030 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:08,032 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:08,067 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs+count-rhs] submitted hadoop job: job_local_0007
2015-02-10 16:16:08,067 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs+count-rhs] tracking url: http://localhost:8080/
2015-02-10 16:16:08,072 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@239b0124
2015-02-10 16:16:08,073 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:08,075 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:08,075 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:08,228 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:08,228 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:08,230 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:08,230 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:08,244 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:08,244 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(count-lhs+count-rhs)[by: count-lhs:[{1}:'char'] count-rhs:[{1}:'char']]
2015-02-10 16:16:08,244 INFO assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:08,246 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:08,246 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 91, total: 395, max: 672
2015-02-10 16:16:08,246 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 58% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:08,247 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:08,248 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 90, total: 395, max: 672
2015-02-10 16:16:08,248 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 58% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:08,249 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:08,249 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 90, total: 395, max: 672
2015-02-10 16:16:08,249 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 58% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:08,250 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:08,250 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 90, total: 395, max: 672
2015-02-10 16:16:08,250 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 58% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:08,251 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:08,254 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:08,255 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0007_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:08,257 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:08,258 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0007_m_000000_0' done.
2015-02-10 16:16:08,260 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@3f610944
2015-02-10 16:16:08,261 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt
2015-02-10 16:16:08,263 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:08,263 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:08,414 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:08,414 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:08,415 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:08,416 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:08,429 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt"]
2015-02-10 16:16:08,429 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(count-lhs+count-rhs)[by: count-lhs:[{1}:'char'] count-rhs:[{1}:'char']]
2015-02-10 16:16:08,430 INFO assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:08,434 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:08,434 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 84, total: 490, max: 672
2015-02-10 16:16:08,434 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 72% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:08,436 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:08,436 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 83, total: 490, max: 672
2015-02-10 16:16:08,436 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 72% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:08,437 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:08,437 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 83, total: 490, max: 672
2015-02-10 16:16:08,437 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 72% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:08,438 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:08,438 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 83, total: 490, max: 672
2015-02-10 16:16:08,438 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 72% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:08,439 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:08,442 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:08,443 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0007_m_000001_0 is done. And is in the process of commiting
2015-02-10 16:16:08,445 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt:0+51
2015-02-10 16:16:08,446 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0007_m_000001_0' done.
2015-02-10 16:16:08,453 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@75db5427
2015-02-10 16:16:08,453 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:08,455 INFO mapred.Merger (Merger.java:merge(390)) - Merging 2 sorted segments
2015-02-10 16:16:08,456 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 2 segments left of total size: 238 bytes
2015-02-10 16:16:08,456 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:08,458 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:08,458 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:08,471 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(count-lhs+count-rhs)[by: count-lhs:[{1}:'char'] count-rhs:[{1}:'char']]
2015-02-10 16:16:08,471 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/mergecount"]
2015-02-10 16:16:08,479 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0007_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:08,480 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:08,481 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local_0007_r_000000_0 is allowed to commit now
2015-02-10 16:16:08,484 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0007_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/mergecount
2015-02-10 16:16:08,484 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:08,485 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0007_r_000000_0' done.
2015-02-10 16:16:08,494 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/mergecount/_temporary
2015-02-10 16:16:08,505 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:08,517 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:08,518 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/mergecount
2015-02-10 16:16:08,534 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:08,534 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:08,557 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [min] starting
2015-02-10 16:16:08,557 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [min] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:08,558 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [min] sink: Hfs["TextDelimited[['char', 'min']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/minbynullsafety"]
2015-02-10 16:16:08,558 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [min] parallel execution is enabled: false
2015-02-10 16:16:08,558 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [min] starting jobs: 1
2015-02-10 16:16:08,558 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [min] allocating threads: 1
2015-02-10 16:16:08,559 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [min] starting step: (1/1) ...splatform/minbynullsafety
2015-02-10 16:16:08,574 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:08,606 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [min] submitted hadoop job: job_local_0008
2015-02-10 16:16:08,607 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [min] tracking url: http://localhost:8080/
2015-02-10 16:16:08,611 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@305f387c
2015-02-10 16:16:08,613 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:08,614 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:08,615 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:08,765 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:08,766 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:08,767 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:08,768 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:08,779 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:08,779 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(min)[by:[{1}:'char']]
2015-02-10 16:16:08,780 INFO assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:08,782 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:08,783 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 40, total: 561, max: 672
2015-02-10 16:16:08,784 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:08,785 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 40, total: 561, max: 672
2015-02-10 16:16:08,786 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:08,787 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 40, total: 561, max: 672
2015-02-10 16:16:08,788 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:08,789 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 40, total: 561, max: 672
2015-02-10 16:16:08,790 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:08,793 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:08,795 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0008_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:08,797 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:08,798 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0008_m_000000_0' done.
2015-02-10 16:16:08,803 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@4cc68351
2015-02-10 16:16:08,804 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:08,806 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:08,807 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 119 bytes
2015-02-10 16:16:08,807 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:08,809 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:08,809 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:08,820 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(min)[by:[{1}:'char']]
2015-02-10 16:16:08,820 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'min']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/minbynullsafety"]
2015-02-10 16:16:08,828 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0008_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:08,829 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:08,830 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local_0008_r_000000_0 is allowed to commit now
2015-02-10 16:16:08,834 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0008_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/minbynullsafety
2015-02-10 16:16:08,835 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:08,836 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0008_r_000000_0' done.
2015-02-10 16:16:08,850 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/minbynullsafety/_temporary
2015-02-10 16:16:08,862 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:08,876 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:08,879 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/minbynullsafety
2015-02-10 16:16:08,898 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:08,899 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:08,926 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [max] starting
2015-02-10 16:16:08,927 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [max] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:08,927 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [max] sink: Hfs["TextDelimited[['num', 'max']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/maxbystring"]
2015-02-10 16:16:08,928 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [max] parallel execution is enabled: false
2015-02-10 16:16:08,928 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [max] starting jobs: 1
2015-02-10 16:16:08,928 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [max] allocating threads: 1
2015-02-10 16:16:08,929 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [max] starting step: (1/1) ...lpersplatform/maxbystring
2015-02-10 16:16:08,942 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:08,979 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [max] submitted hadoop job: job_local_0009
2015-02-10 16:16:08,980 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [max] tracking url: http://localhost:8080/
2015-02-10 16:16:08,984 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@f715510
2015-02-10 16:16:08,985 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:08,987 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:08,987 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:09,350 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:09,351 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:09,352 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:09,352 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:09,362 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:09,362 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(max)[by:[{1}:'num']]
2015-02-10 16:16:09,363 INFO assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:09,365 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:09,365 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 134, total: 239, max: 672
2015-02-10 16:16:09,365 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 35% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:09,366 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:09,366 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 134, total: 239, max: 672
2015-02-10 16:16:09,366 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 35% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:09,367 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:09,369 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:09,371 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0009_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:09,373 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:09,373 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0009_m_000000_0' done.
2015-02-10 16:16:09,377 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@1f5b44d6
2015-02-10 16:16:09,378 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:09,379 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:09,379 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 87 bytes
2015-02-10 16:16:09,380 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:09,381 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:09,381 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:09,390 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(max)[by:[{1}:'num']]
2015-02-10 16:16:09,390 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['num', 'max']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/maxbystring"]
2015-02-10 16:16:09,396 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0009_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:09,397 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:09,398 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local_0009_r_000000_0 is allowed to commit now
2015-02-10 16:16:09,401 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0009_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/maxbystring
2015-02-10 16:16:09,401 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:09,402 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0009_r_000000_0' done.
2015-02-10 16:16:09,414 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/maxbystring/_temporary
2015-02-10 16:16:09,424 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:09,436 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:09,438 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/maxbystring
2015-02-10 16:16:09,455 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:09,456 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:09,483 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [first] starting
2015-02-10 16:16:09,483 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [first] source: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-10 16:16:09,484 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [first] sink: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/firstnfields"]
2015-02-10 16:16:09,484 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [first] parallel execution is enabled: false
2015-02-10 16:16:09,484 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [first] starting jobs: 1
2015-02-10 16:16:09,485 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [first] allocating threads: 1
2015-02-10 16:16:09,486 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [first] starting step: (1/1) ...persplatform/firstnfields
2015-02-10 16:16:09,499 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:09,526 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [first] submitted hadoop job: job_local_0010
2015-02-10 16:16:09,527 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [first] tracking url: http://localhost:8080/
2015-02-10 16:16:09,530 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@2b890c67
2015-02-10 16:16:09,532 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs+rhs-cross.txt
2015-02-10 16:16:09,533 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:09,533 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:09,673 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:09,673 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:09,676 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:09,677 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:09,685 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs+rhs-cross.txt"]
2015-02-10 16:16:09,685 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(first)[by:[{1}:'num']]
2015-02-10 16:16:09,686 INFO assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:09,689 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:09,689 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 114, total: 334, max: 672
2015-02-10 16:16:09,690 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 49% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:09,691 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:09,691 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 114, total: 334, max: 672
2015-02-10 16:16:09,692 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 49% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:09,693 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:09,696 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:09,697 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0010_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:09,699 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs+rhs-cross.txt:0+221
2015-02-10 16:16:09,699 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0010_m_000000_0' done.
2015-02-10 16:16:09,703 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@64e48e45
2015-02-10 16:16:09,703 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:09,705 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:09,705 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 182 bytes
2015-02-10 16:16:09,706 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:09,707 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:09,707 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:09,714 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(first)[by:[{1}:'num']]
2015-02-10 16:16:09,715 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/firstnfields"]
2015-02-10 16:16:09,721 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0010_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:09,722 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:09,723 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local_0010_r_000000_0 is allowed to commit now
2015-02-10 16:16:09,726 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0010_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/firstnfields
2015-02-10 16:16:09,726 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:09,727 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0010_r_000000_0' done.
2015-02-10 16:16:09,740 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/firstnfields/_temporary
2015-02-10 16:16:09,750 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:09,752 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/firstnfields
2015-02-10 16:16:09,769 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:09,769 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:09,791 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [coerce] starting
2015-02-10 16:16:09,791 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [coerce] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt"]
2015-02-10 16:16:09,791 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [coerce] sink: Hfs["TextLine[['line']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/coercefields"]
2015-02-10 16:16:09,792 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [coerce] parallel execution is enabled: false
2015-02-10 16:16:09,792 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [coerce] starting jobs: 1
2015-02-10 16:16:09,792 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [coerce] allocating threads: 1
2015-02-10 16:16:09,793 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [coerce] starting step: (1/1) ...persplatform/coercefields
2015-02-10 16:16:09,803 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:09,828 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [coerce] submitted hadoop job: job_local_0011
2015-02-10 16:16:09,828 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [coerce] tracking url: http://localhost:8080/
2015-02-10 16:16:09,832 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@6d4e5d57
2015-02-10 16:16:09,834 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt
2015-02-10 16:16:09,835 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 0
2015-02-10 16:16:09,839 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:09,839 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:09,847 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt"]
2015-02-10 16:16:09,848 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['line']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/coercefields"]
2015-02-10 16:16:09,857 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0011_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:09,857 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:09,858 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local_0011_m_000000_0 is allowed to commit now
2015-02-10 16:16:09,862 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0011_m_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/coercefields
2015-02-10 16:16:09,863 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt:0+19
2015-02-10 16:16:09,864 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0011_m_000000_0' done.
2015-02-10 16:16:09,869 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/coercefields/_temporary
2015-02-10 16:16:09,879 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:09,881 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/coercefields
2015-02-10 16:16:09,894 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:09,896 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:09,913 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] starting
2015-02-10 16:16:09,914 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:09,914 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] sink: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/count"]
2015-02-10 16:16:09,914 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] parallel execution is enabled: false
2015-02-10 16:16:09,914 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] starting jobs: 1
2015-02-10 16:16:09,915 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] allocating threads: 1
2015-02-10 16:16:09,915 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] starting step: (1/1) ...mblyhelpersplatform/count
2015-02-10 16:16:09,926 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:09,951 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] submitted hadoop job: job_local_0012
2015-02-10 16:16:09,951 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] tracking url: http://localhost:8080/
2015-02-10 16:16:09,956 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@3639b3a2
2015-02-10 16:16:09,957 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:09,958 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:09,959 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:10,115 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:10,115 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:10,116 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:10,117 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:10,125 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:10,126 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(count)[by:[{1}:'char']]
2015-02-10 16:16:10,126 INFO assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:10,127 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:10,128 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 86, total: 429, max: 672
2015-02-10 16:16:10,128 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 63% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:10,129 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:10,129 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 86, total: 429, max: 672
2015-02-10 16:16:10,129 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 63% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:10,130 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:10,130 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 86, total: 429, max: 672
2015-02-10 16:16:10,130 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 63% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:10,131 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:10,131 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 86, total: 429, max: 672
2015-02-10 16:16:10,131 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 63% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:10,132 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:10,134 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:10,136 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0012_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:10,137 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:10,138 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0012_m_000000_0' done.
2015-02-10 16:16:10,142 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@347cdb
2015-02-10 16:16:10,142 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:10,143 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:10,144 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 119 bytes
2015-02-10 16:16:10,144 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:10,145 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:10,146 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:10,155 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(count)[by:[{1}:'char']]
2015-02-10 16:16:10,155 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/count"]
2015-02-10 16:16:10,161 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0012_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:10,162 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:10,162 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local_0012_r_000000_0 is allowed to commit now
2015-02-10 16:16:10,165 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0012_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/count
2015-02-10 16:16:10,166 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:10,167 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0012_r_000000_0' done.
2015-02-10 16:16:10,176 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/count/_temporary
2015-02-10 16:16:10,185 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:10,197 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:10,199 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/count
2015-02-10 16:16:10,215 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:10,216 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:10,234 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [max] starting
2015-02-10 16:16:10,235 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [max] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:10,235 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [max] sink: Hfs["TextDelimited[['char', 'max']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/maxby"]
2015-02-10 16:16:10,235 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [max] parallel execution is enabled: false
2015-02-10 16:16:10,236 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [max] starting jobs: 1
2015-02-10 16:16:10,236 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [max] allocating threads: 1
2015-02-10 16:16:10,236 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [max] starting step: (1/1) ...mblyhelpersplatform/maxby
2015-02-10 16:16:10,247 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:10,271 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [max] submitted hadoop job: job_local_0013
2015-02-10 16:16:10,274 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [max] tracking url: http://localhost:8080/
2015-02-10 16:16:10,277 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@57102fab
2015-02-10 16:16:10,280 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:10,281 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:10,282 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:10,438 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:10,438 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:10,440 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:10,440 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:10,449 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:10,450 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(max)[by:[{1}:'char']]
2015-02-10 16:16:10,450 INFO assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:10,452 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:10,452 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 68, total: 524, max: 672
2015-02-10 16:16:10,452 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 77% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:10,453 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:10,453 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 68, total: 524, max: 672
2015-02-10 16:16:10,454 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 77% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:10,454 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:10,455 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 68, total: 524, max: 672
2015-02-10 16:16:10,455 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 77% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:10,456 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:10,456 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 68, total: 524, max: 672
2015-02-10 16:16:10,456 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 77% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:10,457 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:10,460 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:10,461 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0013_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:10,463 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:10,464 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0013_m_000000_0' done.
2015-02-10 16:16:10,468 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@352e71c4
2015-02-10 16:16:10,468 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:10,469 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:10,470 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 155 bytes
2015-02-10 16:16:10,470 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:10,471 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:10,471 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:10,480 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(max)[by:[{1}:'char']]
2015-02-10 16:16:10,481 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'max']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/maxby"]
2015-02-10 16:16:10,487 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0013_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:10,488 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:10,489 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local_0013_r_000000_0 is allowed to commit now
2015-02-10 16:16:10,492 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0013_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/maxby
2015-02-10 16:16:10,492 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:10,493 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0013_r_000000_0' done.
2015-02-10 16:16:10,497 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/maxby/_temporary
2015-02-10 16:16:10,508 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:10,520 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:10,522 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/maxby
2015-02-10 16:16:10,537 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:10,538 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:10,555 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [min] starting
2015-02-10 16:16:10,556 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [min] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:10,566 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [min] sink: Hfs["TextDelimited[['char', 'min']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/minby"]
2015-02-10 16:16:10,566 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [min] parallel execution is enabled: false
2015-02-10 16:16:10,567 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [min] starting jobs: 1
2015-02-10 16:16:10,567 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [min] allocating threads: 1
2015-02-10 16:16:10,568 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [min] starting step: (1/1) ...mblyhelpersplatform/minby
2015-02-10 16:16:10,578 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:10,601 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [min] submitted hadoop job: job_local_0014
2015-02-10 16:16:10,602 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [min] tracking url: http://localhost:8080/
2015-02-10 16:16:10,604 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@47b6617
2015-02-10 16:16:10,606 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:10,607 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:10,607 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:10,740 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:10,740 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:10,742 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:10,742 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:10,750 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:10,750 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(min)[by:[{1}:'char']]
2015-02-10 16:16:10,751 INFO assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:10,752 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:10,752 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 96, total: 591, max: 672
2015-02-10 16:16:10,753 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:10,753 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 96, total: 591, max: 672
2015-02-10 16:16:10,754 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:10,754 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 96, total: 591, max: 672
2015-02-10 16:16:10,755 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:10,755 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 96, total: 591, max: 672
2015-02-10 16:16:10,756 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:10,758 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:10,759 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0014_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:10,760 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:10,761 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0014_m_000000_0' done.
2015-02-10 16:16:10,764 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@7192efd
2015-02-10 16:16:10,765 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:10,766 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:10,766 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 155 bytes
2015-02-10 16:16:10,767 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:10,767 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:10,768 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:10,775 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(min)[by:[{1}:'char']]
2015-02-10 16:16:10,775 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'min']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/minby"]
2015-02-10 16:16:10,780 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0014_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:10,781 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:10,782 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local_0014_r_000000_0 is allowed to commit now
2015-02-10 16:16:10,784 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0014_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/minby
2015-02-10 16:16:10,784 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:10,785 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0014_r_000000_0' done.
2015-02-10 16:16:10,794 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/minby/_temporary
2015-02-10 16:16:10,804 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:10,814 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:10,815 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/minby
2015-02-10 16:16:10,827 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:10,828 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:10,844 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [sum] starting
2015-02-10 16:16:10,844 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [sum] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:10,844 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [sum] sink: Hfs["TextDelimited[['char', 'sum']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/sum"]
2015-02-10 16:16:10,844 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [sum] parallel execution is enabled: false
2015-02-10 16:16:10,845 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [sum] starting jobs: 1
2015-02-10 16:16:10,845 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [sum] allocating threads: 1
2015-02-10 16:16:10,845 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [sum] starting step: (1/1) ...semblyhelpersplatform/sum
2015-02-10 16:16:10,856 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:10,880 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [sum] submitted hadoop job: job_local_0015
2015-02-10 16:16:10,880 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [sum] tracking url: http://localhost:8080/
2015-02-10 16:16:10,883 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@1c90a278
2015-02-10 16:16:10,884 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:10,885 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:10,886 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:11,193 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:11,194 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:11,195 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:11,195 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:11,205 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:11,205 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(sum)[by:[{1}:'char']]
2015-02-10 16:16:11,205 INFO assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:11,207 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:11,207 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 83, total: 188, max: 672
2015-02-10 16:16:11,207 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 27% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:11,208 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:11,209 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 83, total: 188, max: 672
2015-02-10 16:16:11,209 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 27% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:11,210 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:11,210 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 83, total: 188, max: 672
2015-02-10 16:16:11,210 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 27% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:11,211 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:11,211 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 83, total: 188, max: 672
2015-02-10 16:16:11,211 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 27% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:11,212 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:11,215 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:11,217 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0015_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:11,218 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:11,219 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0015_m_000000_0' done.
2015-02-10 16:16:11,223 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@655538e5
2015-02-10 16:16:11,223 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:11,224 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:11,225 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 119 bytes
2015-02-10 16:16:11,225 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:11,226 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:11,226 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:11,235 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(sum)[by:[{1}:'char']]
2015-02-10 16:16:11,235 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'sum']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/sum"]
2015-02-10 16:16:11,241 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0015_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:11,242 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:11,243 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local_0015_r_000000_0 is allowed to commit now
2015-02-10 16:16:11,245 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0015_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/sum
2015-02-10 16:16:11,246 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:11,247 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0015_r_000000_0' done.
2015-02-10 16:16:11,255 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/sum/_temporary
2015-02-10 16:16:11,266 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:11,278 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:11,281 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/sum
2015-02-10 16:16:11,298 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:11,299 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:11,323 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [sum-lhs+sum-rhs] starting
2015-02-10 16:16:11,323 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [sum-lhs+sum-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt"]
2015-02-10 16:16:11,324 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [sum-lhs+sum-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:11,324 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [sum-lhs+sum-rhs] sink: Hfs["TextDelimited[['char', 'sum']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/mergesum"]
2015-02-10 16:16:11,324 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [sum-lhs+sum-rhs] parallel execution is enabled: false
2015-02-10 16:16:11,324 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [sum-lhs+sum-rhs] starting jobs: 1
2015-02-10 16:16:11,325 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [sum-lhs+sum-rhs] allocating threads: 1
2015-02-10 16:16:11,325 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [sum-lhs+sum-rhs] starting step: (1/1) ...yhelpersplatform/mergesum
2015-02-10 16:16:11,335 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:11,336 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:11,367 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [sum-lhs+sum-rhs] submitted hadoop job: job_local_0016
2015-02-10 16:16:11,368 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [sum-lhs+sum-rhs] tracking url: http://localhost:8080/
2015-02-10 16:16:11,370 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@35718057
2015-02-10 16:16:11,372 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:11,373 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:11,374 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:11,459 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:11,460 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:11,461 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:11,462 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:11,471 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:11,471 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(sum-lhs+sum-rhs)[by: sum-lhs:[{1}:'char'] sum-rhs:[{1}:'char']]
2015-02-10 16:16:11,472 INFO assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:11,473 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:11,474 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 174, total: 285, max: 672
2015-02-10 16:16:11,474 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 42% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:11,475 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:11,475 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 173, total: 285, max: 672
2015-02-10 16:16:11,475 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 42% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:11,476 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:11,476 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 173, total: 285, max: 672
2015-02-10 16:16:11,476 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 42% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:11,477 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:11,477 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 173, total: 285, max: 672
2015-02-10 16:16:11,477 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 42% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:11,478 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:11,480 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:11,482 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0016_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:11,483 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:11,484 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0016_m_000000_0' done.
2015-02-10 16:16:11,485 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@356a90c9
2015-02-10 16:16:11,487 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt
2015-02-10 16:16:11,488 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:11,488 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:11,508 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:11,508 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:11,510 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:11,510 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:11,519 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt"]
2015-02-10 16:16:11,519 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(sum-lhs+sum-rhs)[by: sum-lhs:[{1}:'char'] sum-rhs:[{1}:'char']]
2015-02-10 16:16:11,520 INFO assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:11,524 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:11,524 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 71, total: 285, max: 672
2015-02-10 16:16:11,524 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 42% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:11,525 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:11,525 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 71, total: 285, max: 672
2015-02-10 16:16:11,525 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 42% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:11,526 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:11,526 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 71, total: 285, max: 672
2015-02-10 16:16:11,527 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 42% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:11,527 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:11,528 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 71, total: 285, max: 672
2015-02-10 16:16:11,528 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 42% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:11,528 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:11,531 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:11,532 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0016_m_000001_0 is done. And is in the process of commiting
2015-02-10 16:16:11,533 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt:0+51
2015-02-10 16:16:11,534 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0016_m_000001_0' done.
2015-02-10 16:16:11,540 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@14f30093
2015-02-10 16:16:11,540 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:11,542 INFO mapred.Merger (Merger.java:merge(390)) - Merging 2 sorted segments
2015-02-10 16:16:11,542 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 2 segments left of total size: 238 bytes
2015-02-10 16:16:11,543 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:11,544 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:11,544 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:11,552 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(sum-lhs+sum-rhs)[by: sum-lhs:[{1}:'char'] sum-rhs:[{1}:'char']]
2015-02-10 16:16:11,552 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'sum']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/mergesum"]
2015-02-10 16:16:11,559 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0016_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:11,560 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:11,560 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local_0016_r_000000_0 is allowed to commit now
2015-02-10 16:16:11,563 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0016_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/mergesum
2015-02-10 16:16:11,563 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:11,564 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0016_r_000000_0' done.
2015-02-10 16:16:11,571 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/mergesum/_temporary
2015-02-10 16:16:11,582 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:11,592 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:11,593 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/mergesum
2015-02-10 16:16:11,605 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:11,606 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:11,618 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [shape] starting
2015-02-10 16:16:11,618 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt"]
2015-02-10 16:16:11,619 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [shape] sink: Hfs["TextLine[['num']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/discardnarrow"]
2015-02-10 16:16:11,619 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [shape] parallel execution is enabled: false
2015-02-10 16:16:11,619 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [shape] starting jobs: 1
2015-02-10 16:16:11,619 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [shape] allocating threads: 1
2015-02-10 16:16:11,620 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] starting step: (1/1) ...ersplatform/discardnarrow
2015-02-10 16:16:11,628 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:11,657 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] submitted hadoop job: job_local_0017
2015-02-10 16:16:11,657 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] tracking url: http://localhost:8080/
2015-02-10 16:16:11,660 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@2cd90727
2015-02-10 16:16:11,662 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt
2015-02-10 16:16:11,672 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 0
2015-02-10 16:16:11,726 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:11,726 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:11,731 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt"]
2015-02-10 16:16:11,731 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['num']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/discardnarrow"]
2015-02-10 16:16:11,733 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0017_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:11,734 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:11,734 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local_0017_m_000000_0 is allowed to commit now
2015-02-10 16:16:11,737 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0017_m_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/discardnarrow
2015-02-10 16:16:11,737 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt:0+19
2015-02-10 16:16:11,738 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0017_m_000000_0' done.
2015-02-10 16:16:11,742 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/discardnarrow/_temporary
2015-02-10 16:16:11,750 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:11,752 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/discardnarrow
2015-02-10 16:16:11,763 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:11,763 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:11,773 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [shape] starting
2015-02-10 16:16:11,774 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt"]
2015-02-10 16:16:11,774 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [shape] sink: Hfs["TextLine[['line']->['item', 'element']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/rename"]
2015-02-10 16:16:11,774 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [shape] parallel execution is enabled: false
2015-02-10 16:16:11,774 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [shape] starting jobs: 1
2015-02-10 16:16:11,774 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [shape] allocating threads: 1
2015-02-10 16:16:11,775 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] starting step: (1/1) ...blyhelpersplatform/rename
2015-02-10 16:16:11,783 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:11,805 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] submitted hadoop job: job_local_0018
2015-02-10 16:16:11,805 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] tracking url: http://localhost:8080/
2015-02-10 16:16:11,808 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@1ff05076
2015-02-10 16:16:11,809 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt
2015-02-10 16:16:11,810 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 0
2015-02-10 16:16:11,813 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:11,813 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:11,818 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt"]
2015-02-10 16:16:11,818 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['line']->['item', 'element']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/rename"]
2015-02-10 16:16:11,820 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0018_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:11,820 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:11,821 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local_0018_m_000000_0 is allowed to commit now
2015-02-10 16:16:11,823 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0018_m_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/rename
2015-02-10 16:16:11,824 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt:0+19
2015-02-10 16:16:11,824 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0018_m_000000_0' done.
2015-02-10 16:16:11,836 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/rename/_temporary
2015-02-10 16:16:11,845 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:11,846 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/rename
2015-02-10 16:16:11,862 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:11,862 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:11,885 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [name] starting
2015-02-10 16:16:11,886 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt"]
2015-02-10 16:16:11,886 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:11,886 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [name] sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/multimerge+true"]
2015-02-10 16:16:11,886 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [name] parallel execution is enabled: false
2015-02-10 16:16:11,886 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [name] starting jobs: 1
2015-02-10 16:16:11,887 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [name] allocating threads: 1
2015-02-10 16:16:11,887 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [name] starting step: (1/1) ...splatform/multimerge+true
2015-02-10 16:16:11,896 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:11,897 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:11,919 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [name] submitted hadoop job: job_local_0019
2015-02-10 16:16:11,919 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [name] tracking url: http://localhost:8080/
2015-02-10 16:16:11,922 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@70d9cc1a
2015-02-10 16:16:11,923 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:11,924 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:11,925 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:11,944 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:11,944 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:11,946 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:11,946 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:11,957 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:11,957 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2015-02-10 16:16:11,959 INFO assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:11,960 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:11,960 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 111, total: 341, max: 672
2015-02-10 16:16:11,960 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 50% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:11,962 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:11,962 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 111, total: 341, max: 672
2015-02-10 16:16:11,962 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 50% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:11,963 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:11,963 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 111, total: 341, max: 672
2015-02-10 16:16:11,963 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 50% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:11,964 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:11,964 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 111, total: 341, max: 672
2015-02-10 16:16:11,964 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 50% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:11,965 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:11,967 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:11,969 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0019_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:11,970 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:11,971 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0019_m_000000_0' done.
2015-02-10 16:16:11,972 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@6013a567
2015-02-10 16:16:11,974 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt
2015-02-10 16:16:11,975 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:11,975 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:12,136 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:12,136 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:12,139 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:12,139 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:12,151 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt"]
2015-02-10 16:16:12,151 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2015-02-10 16:16:12,152 INFO assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:12,156 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:12,157 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 103, total: 436, max: 672
2015-02-10 16:16:12,157 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 64% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:12,158 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:12,159 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 103, total: 436, max: 672
2015-02-10 16:16:12,159 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 64% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:12,160 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:12,160 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 103, total: 436, max: 672
2015-02-10 16:16:12,161 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 64% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:12,162 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:12,162 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 103, total: 436, max: 672
2015-02-10 16:16:12,162 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 64% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:12,163 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:12,166 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:12,167 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0019_m_000001_0 is done. And is in the process of commiting
2015-02-10 16:16:12,169 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt:0+51
2015-02-10 16:16:12,170 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0019_m_000001_0' done.
2015-02-10 16:16:12,176 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@6c12a801
2015-02-10 16:16:12,176 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:12,179 INFO mapred.Merger (Merger.java:merge(390)) - Merging 2 sorted segments
2015-02-10 16:16:12,183 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 2 segments left of total size: 472 bytes
2015-02-10 16:16:12,183 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:12,185 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:12,185 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:12,197 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(name)[by:[{1}:'char']]
2015-02-10 16:16:12,197 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/multimerge+true"]
2015-02-10 16:16:12,206 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0019_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:12,207 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:12,208 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local_0019_r_000000_0 is allowed to commit now
2015-02-10 16:16:12,211 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0019_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/multimerge+true
2015-02-10 16:16:12,212 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:12,213 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0019_r_000000_0' done.
2015-02-10 16:16:12,223 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/multimerge+true/_temporary
2015-02-10 16:16:12,233 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:12,245 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:12,247 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/multimerge+true
2015-02-10 16:16:12,267 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:12,268 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:12,307 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [second] starting
2015-02-10 16:16:12,308 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [second] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:12,308 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [second] sink: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/samesourcemergecount"]
2015-02-10 16:16:12,308 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [second] parallel execution is enabled: false
2015-02-10 16:16:12,308 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [second] starting jobs: 2
2015-02-10 16:16:12,309 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [second] allocating threads: 1
2015-02-10 16:16:12,309 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [second] starting step: (1/2)
2015-02-10 16:16:12,319 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:12,347 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [second] submitted hadoop job: job_local_0020
2015-02-10 16:16:12,347 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [second] tracking url: http://localhost:8080/
2015-02-10 16:16:12,350 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@1b0585c7
2015-02-10 16:16:12,352 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:12,353 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:12,353 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:12,509 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:12,509 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:12,511 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:12,511 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:12,520 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:12,521 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(first)[by:[{1}:'char']]
2015-02-10 16:16:12,521 INFO assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:12,525 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:12,525 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 81, total: 531, max: 672
2015-02-10 16:16:12,526 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 79% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:12,527 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:12,527 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 81, total: 531, max: 672
2015-02-10 16:16:12,527 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 79% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:12,528 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:12,528 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 81, total: 531, max: 672
2015-02-10 16:16:12,529 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 79% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:12,529 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:12,530 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 81, total: 531, max: 672
2015-02-10 16:16:12,530 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 79% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:12,531 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:12,533 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:12,535 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0020_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:12,536 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:12,537 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0020_m_000000_0' done.
2015-02-10 16:16:12,541 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@3274eb8a
2015-02-10 16:16:12,541 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:12,542 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:12,543 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 119 bytes
2015-02-10 16:16:12,543 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:12,544 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:12,545 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:12,552 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(first)[by:[{1}:'char']]
2015-02-10 16:16:12,553 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: TempHfs["SequenceFile[['char', 'count']]"][8372234188/first/]
2015-02-10 16:16:12,558 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0020_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:12,558 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:12,559 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local_0020_r_000000_0 is allowed to commit now
2015-02-10 16:16:12,562 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0020_r_000000_0' to file:/tmp/hadoop-teamcity/8372234188_first_3495EFE8D5974B688FB0738034BE429E
2015-02-10 16:16:12,562 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:12,563 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0020_r_000000_0' done.
2015-02-10 16:16:12,570 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [second] starting step: (2/2) ...form/samesourcemergecount
2015-02-10 16:16:12,579 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:12,608 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [second] submitted hadoop job: job_local_0021
2015-02-10 16:16:12,608 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [second] tracking url: http://localhost:8080/
2015-02-10 16:16:12,611 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@7c5acf13
2015-02-10 16:16:12,612 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/8372234188_first_3495EFE8D5974B688FB0738034BE429E/part-00000
2015-02-10 16:16:12,614 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:12,614 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:12,752 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:12,753 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:12,754 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:12,754 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:12,765 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][8372234188/first/]
2015-02-10 16:16:12,765 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(second)[by:[{1}:'char']]
2015-02-10 16:16:12,766 INFO assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:12,767 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:12,767 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 68, total: 626, max: 672
2015-02-10 16:16:12,768 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:12,768 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 68, total: 626, max: 672
2015-02-10 16:16:12,769 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:12,771 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:12,773 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0021_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:12,774 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/tmp/hadoop-teamcity/8372234188_first_3495EFE8D5974B688FB0738034BE429E/part-00000:0+160
2015-02-10 16:16:12,775 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0021_m_000000_0' done.
2015-02-10 16:16:12,779 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@74a893ff
2015-02-10 16:16:12,779 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:12,780 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:12,781 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 67 bytes
2015-02-10 16:16:12,781 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:12,782 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:12,782 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:12,792 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(second)[by:[{1}:'char']]
2015-02-10 16:16:12,792 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/samesourcemergecount"]
2015-02-10 16:16:12,797 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0021_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:12,798 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:12,799 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local_0021_r_000000_0 is allowed to commit now
2015-02-10 16:16:12,802 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0021_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/samesourcemergecount
2015-02-10 16:16:12,802 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:12,803 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0021_r_000000_0' done.
2015-02-10 16:16:12,811 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/samesourcemergecount/_temporary
2015-02-10 16:16:12,822 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:12,834 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:12,836 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/samesourcemergecount
2015-02-10 16:16:12,853 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:12,854 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:12,868 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [average] starting
2015-02-10 16:16:12,869 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [average] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:12,869 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [average] sink: Hfs["TextDelimited[['char', 'average']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/average"]
2015-02-10 16:16:12,869 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [average] parallel execution is enabled: false
2015-02-10 16:16:12,869 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [average] starting jobs: 1
2015-02-10 16:16:12,869 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [average] allocating threads: 1
2015-02-10 16:16:12,870 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [average] starting step: (1/1) ...lyhelpersplatform/average
2015-02-10 16:16:12,879 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:12,913 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [average] submitted hadoop job: job_local_0022
2015-02-10 16:16:12,913 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [average] tracking url: http://localhost:8080/
2015-02-10 16:16:12,917 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@49e5ab72
2015-02-10 16:16:12,919 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:12,920 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:12,920 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:12,939 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:12,940 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:12,941 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:12,941 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:12,949 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:12,950 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(average)[by:[{1}:'char']]
2015-02-10 16:16:12,950 INFO assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:12,952 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:12,952 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 133, total: 629, max: 672
2015-02-10 16:16:12,953 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:12,953 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 133, total: 629, max: 672
2015-02-10 16:16:12,955 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:12,956 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 133, total: 629, max: 672
2015-02-10 16:16:12,956 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:12,957 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 133, total: 629, max: 672
2015-02-10 16:16:12,957 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:12,960 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:12,961 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0022_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:12,962 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:12,963 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0022_m_000000_0' done.
2015-02-10 16:16:12,967 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@bb081e3
2015-02-10 16:16:12,967 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:12,968 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:12,968 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 200 bytes
2015-02-10 16:16:12,969 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:12,970 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:12,970 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:12,976 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(average)[by:[{1}:'char']]
2015-02-10 16:16:12,976 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'average']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/average"]
2015-02-10 16:16:12,982 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0022_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:12,982 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:12,983 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local_0022_r_000000_0 is allowed to commit now
2015-02-10 16:16:12,986 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0022_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/average
2015-02-10 16:16:12,986 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:12,989 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0022_r_000000_0' done.
2015-02-10 16:16:13,000 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/average/_temporary
2015-02-10 16:16:13,008 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:13,018 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:13,020 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/average
2015-02-10 16:16:13,032 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:13,032 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:13,043 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [max] starting
2015-02-10 16:16:13,044 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [max] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:13,044 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [max] sink: Hfs["TextDelimited[['char', 'max']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/maxbynullsafety"]
2015-02-10 16:16:13,044 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [max] parallel execution is enabled: false
2015-02-10 16:16:13,045 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [max] starting jobs: 1
2015-02-10 16:16:13,045 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [max] allocating threads: 1
2015-02-10 16:16:13,046 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [max] starting step: (1/1) ...splatform/maxbynullsafety
2015-02-10 16:16:13,055 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:13,079 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [max] submitted hadoop job: job_local_0023
2015-02-10 16:16:13,080 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [max] tracking url: http://localhost:8080/
2015-02-10 16:16:13,082 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@78d15e01
2015-02-10 16:16:13,084 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:13,085 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:13,085 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:13,241 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:13,241 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:13,242 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:13,242 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:13,249 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:13,250 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(max)[by:[{1}:'char']]
2015-02-10 16:16:13,250 INFO assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:13,251 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:13,252 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 81, total: 692, max: 692
2015-02-10 16:16:13,253 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:13,253 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 81, total: 692, max: 692
2015-02-10 16:16:13,254 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:13,254 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 81, total: 692, max: 692
2015-02-10 16:16:13,254 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:13,255 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 81, total: 692, max: 692
2015-02-10 16:16:13,255 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:13,258 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:13,259 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0023_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:13,260 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:13,261 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0023_m_000000_0' done.
2015-02-10 16:16:13,264 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@5cd37d44
2015-02-10 16:16:13,264 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:13,266 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:13,266 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 118 bytes
2015-02-10 16:16:13,266 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:13,267 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:13,267 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:13,274 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(max)[by:[{1}:'char']]
2015-02-10 16:16:13,274 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'max']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/maxbynullsafety"]
2015-02-10 16:16:13,279 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0023_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:13,279 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:13,280 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local_0023_r_000000_0 is allowed to commit now
2015-02-10 16:16:13,283 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0023_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/maxbynullsafety
2015-02-10 16:16:13,283 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:13,284 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0023_r_000000_0' done.
2015-02-10 16:16:13,293 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/maxbynullsafety/_temporary
2015-02-10 16:16:13,301 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:13,311 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:13,313 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/maxbynullsafety
2015-02-10 16:16:13,325 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:13,325 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:13,338 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [sum] starting
2015-02-10 16:16:13,338 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [sum] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:13,339 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [sum] sink: Hfs["TextDelimited[['char', 'sum']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/sumnulls"]
2015-02-10 16:16:13,339 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [sum] parallel execution is enabled: false
2015-02-10 16:16:13,339 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [sum] starting jobs: 1
2015-02-10 16:16:13,339 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [sum] allocating threads: 1
2015-02-10 16:16:13,340 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [sum] starting step: (1/1) ...yhelpersplatform/sumnulls
2015-02-10 16:16:13,349 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:13,379 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [sum] submitted hadoop job: job_local_0024
2015-02-10 16:16:13,379 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [sum] tracking url: http://localhost:8080/
2015-02-10 16:16:13,382 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@10f946f9
2015-02-10 16:16:13,383 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:13,385 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:13,385 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:13,683 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:13,683 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:13,684 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:13,685 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:13,691 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:13,691 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(sum)[by:[{1}:'char']]
2015-02-10 16:16:13,692 INFO assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:13,701 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:13,701 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 146, total: 252, max: 672
2015-02-10 16:16:13,702 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 37% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:13,703 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:13,703 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 146, total: 252, max: 672
2015-02-10 16:16:13,703 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 37% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:13,704 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:13,704 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 146, total: 252, max: 672
2015-02-10 16:16:13,704 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 37% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:13,705 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:13,705 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 146, total: 252, max: 672
2015-02-10 16:16:13,705 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 37% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:13,706 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:13,708 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:13,709 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0024_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:13,710 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:13,711 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0024_m_000000_0' done.
2015-02-10 16:16:13,714 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@3107eafc
2015-02-10 16:16:13,714 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:13,716 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:13,716 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 116 bytes
2015-02-10 16:16:13,716 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:13,717 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:13,717 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:13,723 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(sum)[by:[{1}:'char']]
2015-02-10 16:16:13,723 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'sum']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/sumnulls"]
2015-02-10 16:16:13,728 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0024_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:13,729 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:13,730 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local_0024_r_000000_0 is allowed to commit now
2015-02-10 16:16:13,732 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0024_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/sumnulls
2015-02-10 16:16:13,732 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:13,733 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0024_r_000000_0' done.
2015-02-10 16:16:13,737 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/sumnulls/_temporary
2015-02-10 16:16:13,746 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:13,755 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:13,757 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/sumnulls
2015-02-10 16:16:13,768 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:13,769 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:13,780 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] starting
2015-02-10 16:16:13,780 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:13,780 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] sink: Hfs["TextDelimited[['count']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/countall"]
2015-02-10 16:16:13,781 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] parallel execution is enabled: false
2015-02-10 16:16:13,781 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] starting jobs: 1
2015-02-10 16:16:13,781 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] allocating threads: 1
2015-02-10 16:16:13,782 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] starting step: (1/1) ...yhelpersplatform/countall
2015-02-10 16:16:13,790 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:13,814 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] submitted hadoop job: job_local_0025
2015-02-10 16:16:13,815 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] tracking url: http://localhost:8080/
2015-02-10 16:16:13,817 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@2bebde03
2015-02-10 16:16:13,819 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:13,820 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:13,820 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:13,890 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:13,890 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:13,891 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:13,892 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:13,899 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:13,899 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(count)[by:[{?}:NONE]]
2015-02-10 16:16:13,900 INFO assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:13,902 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:13,903 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:13,905 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0025_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:13,906 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:13,906 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0025_m_000000_0' done.
2015-02-10 16:16:13,910 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@24458e29
2015-02-10 16:16:13,910 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:13,911 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:13,911 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 8 bytes
2015-02-10 16:16:13,912 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:13,912 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:13,913 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:13,919 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(count)[by:[{?}:NONE]]
2015-02-10 16:16:13,919 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['count']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/countall"]
2015-02-10 16:16:13,923 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0025_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:13,923 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:13,924 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local_0025_r_000000_0 is allowed to commit now
2015-02-10 16:16:13,927 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0025_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/countall
2015-02-10 16:16:13,927 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:13,928 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0025_r_000000_0' done.
2015-02-10 16:16:13,937 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/countall/_temporary
2015-02-10 16:16:13,946 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:13,955 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:13,956 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/countall
2015-02-10 16:16:13,970 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:13,971 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:13,985 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [name] starting
2015-02-10 16:16:13,986 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:13,986 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [name] sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average', 'average2', 'first']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/multi"]
2015-02-10 16:16:13,986 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [name] parallel execution is enabled: false
2015-02-10 16:16:13,987 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [name] starting jobs: 1
2015-02-10 16:16:13,987 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [name] allocating threads: 1
2015-02-10 16:16:13,988 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [name] starting step: (1/1) ...mblyhelpersplatform/multi
2015-02-10 16:16:13,996 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:14,018 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [name] submitted hadoop job: job_local_0026
2015-02-10 16:16:14,018 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [name] tracking url: http://localhost:8080/
2015-02-10 16:16:14,022 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@28a38b58
2015-02-10 16:16:14,023 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:14,024 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:14,025 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:14,175 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:14,175 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:14,177 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:14,177 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:14,188 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:14,188 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2015-02-10 16:16:14,189 INFO assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:14,191 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:14,191 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 106, total: 442, max: 672
2015-02-10 16:16:14,192 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 65% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:14,193 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:14,194 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 106, total: 442, max: 672
2015-02-10 16:16:14,194 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 65% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:14,196 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:14,196 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 106, total: 442, max: 672
2015-02-10 16:16:14,196 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 65% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:14,198 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:14,198 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 106, total: 442, max: 672
2015-02-10 16:16:14,198 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(333)) - total mem is 65% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2015-02-10 16:16:14,199 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:14,202 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:14,204 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0026_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:14,205 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:14,206 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0026_m_000000_0' done.
2015-02-10 16:16:14,209 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@79b1a66b
2015-02-10 16:16:14,210 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:14,212 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:14,212 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 452 bytes
2015-02-10 16:16:14,214 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:14,217 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:14,217 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:14,226 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(name)[by:[{1}:'char']]
2015-02-10 16:16:14,226 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average', 'average2', 'first']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/multi"]
2015-02-10 16:16:14,233 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0026_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:14,234 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:14,235 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local_0026_r_000000_0 is allowed to commit now
2015-02-10 16:16:14,237 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0026_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/multi
2015-02-10 16:16:14,237 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:14,238 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0026_r_000000_0' done.
2015-02-10 16:16:14,241 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/multi/_temporary
2015-02-10 16:16:14,250 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:14,260 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:14,262 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/multi
2015-02-10 16:16:14,272 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:14,272 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:14,282 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [shape] starting
2015-02-10 16:16:14,282 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt"]
2015-02-10 16:16:14,283 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [shape] sink: Hfs["TextLine[['num']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/retainnarrow"]
2015-02-10 16:16:14,283 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [shape] parallel execution is enabled: false
2015-02-10 16:16:14,283 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [shape] starting jobs: 1
2015-02-10 16:16:14,283 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [shape] allocating threads: 1
2015-02-10 16:16:14,284 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] starting step: (1/1) ...persplatform/retainnarrow
2015-02-10 16:16:14,292 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:14,314 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] submitted hadoop job: job_local_0027
2015-02-10 16:16:14,314 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] tracking url: http://localhost:8080/
2015-02-10 16:16:14,317 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@21c17f5a
2015-02-10 16:16:14,318 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt
2015-02-10 16:16:14,319 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 0
2015-02-10 16:16:14,322 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:14,322 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:14,328 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt"]
2015-02-10 16:16:14,328 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['num']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/retainnarrow"]
2015-02-10 16:16:14,330 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0027_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:14,331 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:14,332 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local_0027_m_000000_0 is allowed to commit now
2015-02-10 16:16:14,335 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0027_m_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/retainnarrow
2015-02-10 16:16:14,335 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt:0+19
2015-02-10 16:16:14,335 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0027_m_000000_0' done.
2015-02-10 16:16:14,346 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/retainnarrow/_temporary
2015-02-10 16:16:14,354 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:14,356 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/retainnarrow
2015-02-10 16:16:14,366 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:14,366 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:14,374 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [shape] starting
2015-02-10 16:16:14,375 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt"]
2015-02-10 16:16:14,375 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [shape] sink: Hfs["TextLine[['item']->['char', 'item']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/renamenarrow"]
2015-02-10 16:16:14,375 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [shape] parallel execution is enabled: false
2015-02-10 16:16:14,375 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [shape] starting jobs: 1
2015-02-10 16:16:14,375 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [shape] allocating threads: 1
2015-02-10 16:16:14,376 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] starting step: (1/1) ...persplatform/renamenarrow
2015-02-10 16:16:14,384 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:14,404 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] submitted hadoop job: job_local_0028
2015-02-10 16:16:14,404 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] tracking url: http://localhost:8080/
2015-02-10 16:16:14,407 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@5ce33b57
2015-02-10 16:16:14,408 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt
2015-02-10 16:16:14,409 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 0
2015-02-10 16:16:14,411 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:14,412 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:14,415 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt"]
2015-02-10 16:16:14,415 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['item']->['char', 'item']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/renamenarrow"]
2015-02-10 16:16:14,417 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0028_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:14,418 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:14,418 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local_0028_m_000000_0 is allowed to commit now
2015-02-10 16:16:14,420 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0028_m_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/renamenarrow
2015-02-10 16:16:14,421 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt:0+19
2015-02-10 16:16:14,421 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0028_m_000000_0' done.
2015-02-10 16:16:14,425 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/renamenarrow/_temporary
2015-02-10 16:16:14,433 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:14,435 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/renamenarrow
2015-02-10 16:16:14,448 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:14,449 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:14,460 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [average] starting
2015-02-10 16:16:14,460 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [average] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:14,461 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [average] sink: Hfs["TextDelimited[['char', 'average']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/averagenull"]
2015-02-10 16:16:14,461 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [average] parallel execution is enabled: false
2015-02-10 16:16:14,461 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [average] starting jobs: 1
2015-02-10 16:16:14,461 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [average] allocating threads: 1
2015-02-10 16:16:14,462 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [average] starting step: (1/1) ...lpersplatform/averagenull
2015-02-10 16:16:14,469 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:14,490 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [average] submitted hadoop job: job_local_0029
2015-02-10 16:16:14,490 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [average] tracking url: http://localhost:8080/
2015-02-10 16:16:14,493 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@61fba036
2015-02-10 16:16:14,494 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:14,495 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:14,496 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:14,637 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:14,637 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:14,638 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:14,639 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:14,645 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:14,645 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(average)[by:[{1}:'char']]
2015-02-10 16:16:14,646 INFO assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:14,649 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:14,650 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 288, total: 589, max: 672
2015-02-10 16:16:14,651 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:14,651 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 288, total: 589, max: 672
2015-02-10 16:16:14,652 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:14,652 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 288, total: 589, max: 672
2015-02-10 16:16:14,652 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:14,653 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 288, total: 589, max: 672
2015-02-10 16:16:14,653 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:14,656 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:14,657 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0029_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:14,658 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:14,659 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0029_m_000000_0' done.
2015-02-10 16:16:14,662 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@5bb7b7a3
2015-02-10 16:16:14,662 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:14,663 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:14,664 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 200 bytes
2015-02-10 16:16:14,664 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:14,665 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:14,665 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:14,670 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(average)[by:[{1}:'char']]
2015-02-10 16:16:14,670 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'average']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/averagenull"]
2015-02-10 16:16:14,675 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0029_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:14,676 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:14,677 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local_0029_r_000000_0 is allowed to commit now
2015-02-10 16:16:14,679 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0029_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/averagenull
2015-02-10 16:16:14,679 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:14,680 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0029_r_000000_0' done.
2015-02-10 16:16:14,688 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/averagenull/_temporary
2015-02-10 16:16:14,696 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:14,706 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:14,708 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/averagenull
2015-02-10 16:16:14,717 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:14,717 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:14,726 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [coerce] starting
2015-02-10 16:16:14,726 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [coerce] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt"]
2015-02-10 16:16:14,726 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [coerce] sink: Hfs["TextLine[['line']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/coerce"]
2015-02-10 16:16:14,726 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [coerce] parallel execution is enabled: false
2015-02-10 16:16:14,726 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [coerce] starting jobs: 1
2015-02-10 16:16:14,727 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [coerce] allocating threads: 1
2015-02-10 16:16:14,727 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [coerce] starting step: (1/1) ...blyhelpersplatform/coerce
2015-02-10 16:16:14,736 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:14,759 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [coerce] submitted hadoop job: job_local_0030
2015-02-10 16:16:14,759 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [coerce] tracking url: http://localhost:8080/
2015-02-10 16:16:14,761 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@296157ec
2015-02-10 16:16:14,763 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt
2015-02-10 16:16:14,764 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 0
2015-02-10 16:16:14,766 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:14,766 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:14,770 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt"]
2015-02-10 16:16:14,770 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['line']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/coerce"]
2015-02-10 16:16:14,772 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0030_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:14,772 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:14,773 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local_0030_m_000000_0 is allowed to commit now
2015-02-10 16:16:14,775 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0030_m_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/coerce
2015-02-10 16:16:14,775 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lower.txt:0+19
2015-02-10 16:16:14,776 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0030_m_000000_0' done.
2015-02-10 16:16:14,780 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/coerce/_temporary
2015-02-10 16:16:14,789 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:14,790 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/coerce
2015-02-10 16:16:14,801 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:14,801 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:14,811 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [first] starting
2015-02-10 16:16:14,811 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [first] source: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs+rhs-cross-rev.txt"]
2015-02-10 16:16:14,811 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [first] sink: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/firstnfieldswithoutcomparator"]
2015-02-10 16:16:14,812 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [first] parallel execution is enabled: false
2015-02-10 16:16:14,812 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [first] starting jobs: 1
2015-02-10 16:16:14,812 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [first] allocating threads: 1
2015-02-10 16:16:14,813 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [first] starting step: (1/1) ...tnfieldswithoutcomparator
2015-02-10 16:16:14,820 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:14,840 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [first] submitted hadoop job: job_local_0031
2015-02-10 16:16:14,841 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [first] tracking url: http://localhost:8080/
2015-02-10 16:16:14,843 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@15eb9b0d
2015-02-10 16:16:14,845 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs+rhs-cross-rev.txt
2015-02-10 16:16:14,846 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:14,846 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:14,863 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:14,863 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:14,865 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:14,865 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:14,870 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs+rhs-cross-rev.txt"]
2015-02-10 16:16:14,870 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(first)[by:[{1}:'num']]
2015-02-10 16:16:14,871 INFO assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:14,873 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:14,874 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 160, total: 589, max: 672
2015-02-10 16:16:14,875 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:14,875 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 160, total: 589, max: 672
2015-02-10 16:16:14,876 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:14,878 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:14,880 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0031_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:14,881 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs+rhs-cross-rev.txt:0+221
2015-02-10 16:16:14,882 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0031_m_000000_0' done.
2015-02-10 16:16:14,887 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@37811015
2015-02-10 16:16:14,887 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:14,888 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:14,889 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 117 bytes
2015-02-10 16:16:14,889 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:14,890 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:14,890 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:14,894 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(first)[by:[{1}:'num']]
2015-02-10 16:16:14,895 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/firstnfieldswithoutcomparator"]
2015-02-10 16:16:14,899 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0031_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:14,900 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:14,901 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local_0031_r_000000_0 is allowed to commit now
2015-02-10 16:16:14,903 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0031_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/firstnfieldswithoutcomparator
2015-02-10 16:16:14,903 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:14,904 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0031_r_000000_0' done.
2015-02-10 16:16:14,912 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/firstnfieldswithoutcomparator/_temporary
2015-02-10 16:16:14,921 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:14,922 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/firstnfieldswithoutcomparator
2015-02-10 16:16:14,937 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:14,937 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:14,984 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count-lhs*source*count...] starting
2015-02-10 16:16:14,985 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count-lhs*source*count...] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:14,985 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count-lhs*source*count...] sink: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/samesourcemergethreeway"]
2015-02-10 16:16:14,985 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count-lhs*source*count...] parallel execution is enabled: false
2015-02-10 16:16:14,985 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count-lhs*source*count...] starting jobs: 5
2015-02-10 16:16:14,986 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count-lhs*source*count...] allocating threads: 1
2015-02-10 16:16:14,986 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] starting step: (1/5)
2015-02-10 16:16:14,994 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:15,015 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] submitted hadoop job: job_local_0032
2015-02-10 16:16:15,015 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2015-02-10 16:16:15,018 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@7db94a3f
2015-02-10 16:16:15,019 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:15,020 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:15,021 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:15,047 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:15,048 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:15,049 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:15,049 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:15,055 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:15,055 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(source)[by:[{1}:'char']]
2015-02-10 16:16:15,056 INFO assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:15,057 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:15,058 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 193, total: 590, max: 672
2015-02-10 16:16:15,059 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:15,059 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 193, total: 590, max: 672
2015-02-10 16:16:15,060 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 5, with threshold: 2
2015-02-10 16:16:15,060 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 193, total: 590, max: 672
2015-02-10 16:16:15,061 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 7, with threshold: 2
2015-02-10 16:16:15,061 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 193, total: 590, max: 672
2015-02-10 16:16:15,062 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:15,064 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:15,066 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0032_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:15,067 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:15,068 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0032_m_000000_0' done.
2015-02-10 16:16:15,071 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@634366f3
2015-02-10 16:16:15,072 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:15,073 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:15,074 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 119 bytes
2015-02-10 16:16:15,074 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:15,075 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:15,075 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:15,080 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(source)[by:[{1}:'char']]
2015-02-10 16:16:15,080 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: TempHfs["SequenceFile[['char', 'count']]"][7009949486/source/]
2015-02-10 16:16:15,085 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0032_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:15,086 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:15,087 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local_0032_r_000000_0 is allowed to commit now
2015-02-10 16:16:15,089 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0032_r_000000_0' to file:/tmp/hadoop-teamcity/7009949486_source_27C0D93015D946EDB1795C39C6C70515
2015-02-10 16:16:15,089 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:15,090 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0032_r_000000_0' done.
2015-02-10 16:16:15,101 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] starting step: (3/5)
2015-02-10 16:16:15,109 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:15,131 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] submitted hadoop job: job_local_0033
2015-02-10 16:16:15,131 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2015-02-10 16:16:15,134 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@318790d7
2015-02-10 16:16:15,136 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/7009949486_source_27C0D93015D946EDB1795C39C6C70515/part-00000
2015-02-10 16:16:15,137 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:15,137 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:15,195 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:15,196 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:15,197 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:15,197 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:15,202 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][7009949486/source/]
2015-02-10 16:16:15,202 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(count-lhs)[by:[{1}:'char']]
2015-02-10 16:16:15,203 INFO assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:15,204 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:15,204 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 85, total: 590, max: 672
2015-02-10 16:16:15,205 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:15,205 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 85, total: 590, max: 672
2015-02-10 16:16:15,206 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:15,208 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:15,209 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0033_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:15,210 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/tmp/hadoop-teamcity/7009949486_source_27C0D93015D946EDB1795C39C6C70515/part-00000:0+160
2015-02-10 16:16:15,211 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0033_m_000000_0' done.
2015-02-10 16:16:15,215 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@42d32028
2015-02-10 16:16:15,215 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:15,217 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:15,217 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 67 bytes
2015-02-10 16:16:15,218 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:15,219 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:15,219 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:15,224 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(count-lhs)[by:[{1}:'char']]
2015-02-10 16:16:15,224 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: TempHfs["SequenceFile[['char', 'count']]"][3596105809/count-lhs/]
2015-02-10 16:16:15,228 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0033_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:15,229 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:15,230 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local_0033_r_000000_0 is allowed to commit now
2015-02-10 16:16:15,232 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0033_r_000000_0' to file:/tmp/hadoop-teamcity/3596105809_count_lhs_DBC15B14EFFD4F0C8C3FBDE19C4913D3
2015-02-10 16:16:15,232 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:15,233 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0033_r_000000_0' done.
2015-02-10 16:16:15,243 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] starting step: (4/5)
2015-02-10 16:16:15,254 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:15,281 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] submitted hadoop job: job_local_0034
2015-02-10 16:16:15,282 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2015-02-10 16:16:15,284 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@3c8fa832
2015-02-10 16:16:15,286 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/7009949486_source_27C0D93015D946EDB1795C39C6C70515/part-00000
2015-02-10 16:16:15,287 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:15,288 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:15,311 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:15,312 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:15,314 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:15,314 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:15,319 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][7009949486/source/]
2015-02-10 16:16:15,319 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(count-rhs)[by:[{1}:'char']]
2015-02-10 16:16:15,320 INFO assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:15,321 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 1, with threshold: 2
2015-02-10 16:16:15,322 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 193, total: 589, max: 672
2015-02-10 16:16:15,322 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(327)) - flushed keys num times: 3, with threshold: 2
2015-02-10 16:16:15,323 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(328)) - mem on flush (mb), free: 193, total: 589, max: 672
2015-02-10 16:16:15,323 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:15,325 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:15,327 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0034_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:15,328 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/tmp/hadoop-teamcity/7009949486_source_27C0D93015D946EDB1795C39C6C70515/part-00000:0+160
2015-02-10 16:16:15,329 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0034_m_000000_0' done.
2015-02-10 16:16:15,332 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@6bfa2e2e
2015-02-10 16:16:15,332 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:15,334 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:15,334 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 67 bytes
2015-02-10 16:16:15,335 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:15,336 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:15,336 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:15,340 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(count-rhs)[by:[{1}:'char']]
2015-02-10 16:16:15,341 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: TempHfs["SequenceFile[['char', 'count']]"][4238742939/count-rhs/]
2015-02-10 16:16:15,345 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0034_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:15,345 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:15,346 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local_0034_r_000000_0 is allowed to commit now
2015-02-10 16:16:15,348 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0034_r_000000_0' to file:/tmp/hadoop-teamcity/4238742939_count_rhs_75DCECF745E44926BF0EB3B228E69D80
2015-02-10 16:16:15,349 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:15,350 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0034_r_000000_0' done.
2015-02-10 16:16:15,355 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] starting step: (2/5)
2015-02-10 16:16:15,364 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:15,365 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:15,386 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] submitted hadoop job: job_local_0035
2015-02-10 16:16:15,386 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2015-02-10 16:16:15,389 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@299b78d4
2015-02-10 16:16:15,390 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/4238742939_count_rhs_75DCECF745E44926BF0EB3B228E69D80/part-00000
2015-02-10 16:16:15,392 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:15,392 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:15,410 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:15,410 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:15,413 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:15,413 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:15,419 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][4238742939/count-rhs/]
2015-02-10 16:16:15,419 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: CoGroup(source*count-rhs)[by: source:[{1}:'char'] count-rhs:[{1}:'char']]
2015-02-10 16:16:15,421 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:15,423 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:15,425 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0035_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:15,426 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/tmp/hadoop-teamcity/4238742939_count_rhs_75DCECF745E44926BF0EB3B228E69D80/part-00000:0+160
2015-02-10 16:16:15,427 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0035_m_000000_0' done.
2015-02-10 16:16:15,428 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@334ecfe8
2015-02-10 16:16:15,429 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/7009949486_source_27C0D93015D946EDB1795C39C6C70515/part-00000
2015-02-10 16:16:15,431 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:15,431 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:15,455 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:15,455 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:15,457 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:15,457 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:15,462 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][7009949486/source/]
2015-02-10 16:16:15,462 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: CoGroup(source*count-rhs)[by: source:[{1}:'char'] count-rhs:[{1}:'char']]
2015-02-10 16:16:15,464 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:15,466 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:15,467 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0035_m_000001_0 is done. And is in the process of commiting
2015-02-10 16:16:15,468 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/tmp/hadoop-teamcity/7009949486_source_27C0D93015D946EDB1795C39C6C70515/part-00000:0+160
2015-02-10 16:16:15,469 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0035_m_000001_0' done.
2015-02-10 16:16:15,474 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@351037b
2015-02-10 16:16:15,475 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:15,476 INFO mapred.Merger (Merger.java:merge(390)) - Merging 2 sorted segments
2015-02-10 16:16:15,477 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 2 segments left of total size: 154 bytes
2015-02-10 16:16:15,477 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:15,478 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:15,479 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:15,483 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: CoGroup(source*count-rhs)[by: source:[{1}:'char'] count-rhs:[{1}:'char']]
2015-02-10 16:16:15,484 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: TempHfs["SequenceFile[['char', 'num', 'char2', 'count']]"][933824959/source_count-rhs/]
2015-02-10 16:16:15,493 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-02-10 16:16:15,494 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2015-02-10 16:16:15,501 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0035_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:15,501 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:15,502 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local_0035_r_000000_0 is allowed to commit now
2015-02-10 16:16:15,504 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0035_r_000000_0' to file:/tmp/hadoop-teamcity/933824959_source_count_rhs_CAAB53DF86BD44DEA39A36304D82D231
2015-02-10 16:16:15,505 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:15,505 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0035_r_000000_0' done.
2015-02-10 16:16:15,509 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] starting step: (5/5) ...m/samesourcemergethreeway
2015-02-10 16:16:15,518 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:15,519 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:15,539 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] submitted hadoop job: job_local_0036
2015-02-10 16:16:15,540 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2015-02-10 16:16:15,542 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@6bc947
2015-02-10 16:16:15,544 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/933824959_source_count_rhs_CAAB53DF86BD44DEA39A36304D82D231/part-00000
2015-02-10 16:16:15,545 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:15,545 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:15,562 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:15,563 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:15,564 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:15,564 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:15,571 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: TempHfs["SequenceFile[['char', 'num', 'char2', 'count']]"][933824959/source_count-rhs/]
2015-02-10 16:16:15,571 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: CoGroup(count-lhs*source*count-rhs)[by: count-lhs:[{1}:'char'] source*count-rhs:[{1}:'char']]
2015-02-10 16:16:15,572 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:15,574 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:15,576 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0036_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:15,577 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/tmp/hadoop-teamcity/933824959_source_count_rhs_CAAB53DF86BD44DEA39A36304D82D231/part-00000:0+200
2015-02-10 16:16:15,578 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0036_m_000000_0' done.
2015-02-10 16:16:15,579 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@7adc28b2
2015-02-10 16:16:15,582 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/3596105809_count_lhs_DBC15B14EFFD4F0C8C3FBDE19C4913D3/part-00000
2015-02-10 16:16:15,584 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:15,584 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:15,607 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:15,608 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:15,609 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:15,609 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:15,616 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][3596105809/count-lhs/]
2015-02-10 16:16:15,617 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: CoGroup(count-lhs*source*count-rhs)[by: count-lhs:[{1}:'char'] source*count-rhs:[{1}:'char']]
2015-02-10 16:16:15,619 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:15,622 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:15,623 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0036_m_000001_0 is done. And is in the process of commiting
2015-02-10 16:16:15,624 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/tmp/hadoop-teamcity/3596105809_count_lhs_DBC15B14EFFD4F0C8C3FBDE19C4913D3/part-00000:0+160
2015-02-10 16:16:15,625 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0036_m_000001_0' done.
2015-02-10 16:16:15,630 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@311552cd
2015-02-10 16:16:15,631 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:15,632 INFO mapred.Merger (Merger.java:merge(390)) - Merging 2 sorted segments
2015-02-10 16:16:15,633 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 2 segments left of total size: 194 bytes
2015-02-10 16:16:15,633 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:15,634 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:15,634 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:15,640 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: CoGroup(count-lhs*source*count-rhs)[by: count-lhs:[{1}:'char'] source*count-rhs:[{1}:'char']]
2015-02-10 16:16:15,640 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'count']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/samesourcemergethreeway"]
2015-02-10 16:16:15,643 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-02-10 16:16:15,643 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2015-02-10 16:16:15,646 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0036_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:15,646 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:15,647 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local_0036_r_000000_0 is allowed to commit now
2015-02-10 16:16:15,649 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0036_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/samesourcemergethreeway
2015-02-10 16:16:15,649 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:15,650 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0036_r_000000_0' done.
2015-02-10 16:16:15,664 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/samesourcemergethreeway/_temporary
2015-02-10 16:16:15,672 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:15,681 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:15,683 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/samesourcemergethreeway
2015-02-10 16:16:15,696 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:15,697 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:15,712 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs+rhs] starting
2015-02-10 16:16:15,712 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs+rhs] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt"]
2015-02-10 16:16:15,713 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs+rhs] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:15,713 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs+rhs] sink: Hfs["TextLine[['item']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/uniquemerge-nondeterministic"]
2015-02-10 16:16:15,713 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs+rhs] parallel execution is enabled: false
2015-02-10 16:16:15,713 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs+rhs] starting jobs: 1
2015-02-10 16:16:15,713 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs+rhs] allocating threads: 1
2015-02-10 16:16:15,714 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs+rhs] starting step: (1/1) ...quemerge-nondeterministic
2015-02-10 16:16:15,722 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:15,723 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:15,745 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs+rhs] submitted hadoop job: job_local_0037
2015-02-10 16:16:15,745 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs+rhs] tracking url: http://localhost:8080/
2015-02-10 16:16:15,748 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@515a3dac
2015-02-10 16:16:15,749 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:15,751 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:15,751 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:15,772 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:15,772 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:15,774 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:15,774 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:15,779 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:15,779 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(lhs+rhs)[by: lhs:[{1}:'num'] rhs:[{1}:'num']]
2015-02-10 16:16:15,785 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:15,787 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:15,788 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0037_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:15,790 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:15,790 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0037_m_000000_0' done.
2015-02-10 16:16:15,792 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@299264e3
2015-02-10 16:16:15,794 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt
2015-02-10 16:16:15,795 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:15,796 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:15,820 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:15,821 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:15,822 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:15,822 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:15,827 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt"]
2015-02-10 16:16:15,827 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(lhs+rhs)[by: lhs:[{1}:'num'] rhs:[{1}:'num']]
2015-02-10 16:16:15,830 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:15,832 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:15,834 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0037_m_000001_0 is done. And is in the process of commiting
2015-02-10 16:16:15,835 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/rhs.txt:0+51
2015-02-10 16:16:15,836 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0037_m_000001_0' done.
2015-02-10 16:16:15,841 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@2bc674d8
2015-02-10 16:16:15,842 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:15,843 INFO mapred.Merger (Merger.java:merge(390)) - Merging 2 sorted segments
2015-02-10 16:16:15,844 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 2 segments left of total size: 174 bytes
2015-02-10 16:16:15,844 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:15,845 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:15,846 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:15,850 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(lhs+rhs)[by: lhs:[{1}:'num'] rhs:[{1}:'num']]
2015-02-10 16:16:15,851 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['item']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/uniquemerge-nondeterministic"]
2015-02-10 16:16:15,857 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0037_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:15,858 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:15,859 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local_0037_r_000000_0 is allowed to commit now
2015-02-10 16:16:15,861 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0037_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/uniquemerge-nondeterministic
2015-02-10 16:16:15,862 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:15,863 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0037_r_000000_0' done.
2015-02-10 16:16:15,873 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/uniquemerge-nondeterministic/_temporary
2015-02-10 16:16:15,882 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:15,883 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/uniquemerge-nondeterministic
2015-02-10 16:16:15,893 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:15,894 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:15,903 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [shape] starting
2015-02-10 16:16:15,903 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:15,903 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [shape] sink: Hfs["TextLine[['item']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/unique"]
2015-02-10 16:16:15,904 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [shape] parallel execution is enabled: false
2015-02-10 16:16:15,904 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [shape] starting jobs: 1
2015-02-10 16:16:15,904 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [shape] allocating threads: 1
2015-02-10 16:16:15,905 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] starting step: (1/1) ...blyhelpersplatform/unique
2015-02-10 16:16:15,913 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:15,933 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] submitted hadoop job: job_local_0038
2015-02-10 16:16:15,933 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] tracking url: http://localhost:8080/
2015-02-10 16:16:15,936 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@6ea27cbe
2015-02-10 16:16:15,937 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:15,938 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:15,939 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:15,956 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:15,956 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:15,957 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:15,957 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:15,961 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:15,961 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(shape)[by:[{1}:'num']]
2015-02-10 16:16:15,964 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:15,966 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:15,967 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0038_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:15,968 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:15,969 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0038_m_000000_0' done.
2015-02-10 16:16:15,972 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@6cb36431
2015-02-10 16:16:15,972 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:15,973 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:15,975 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 87 bytes
2015-02-10 16:16:15,975 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:15,976 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:15,976 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:15,981 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(shape)[by:[{1}:'num']]
2015-02-10 16:16:15,981 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['item']->['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/unique"]
2015-02-10 16:16:15,986 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0038_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:15,987 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:15,988 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local_0038_r_000000_0 is allowed to commit now
2015-02-10 16:16:15,990 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0038_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/unique
2015-02-10 16:16:15,991 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:15,992 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0038_r_000000_0' done.
2015-02-10 16:16:15,995 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/unique/_temporary
2015-02-10 16:16:16,005 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:16,007 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/unique
2015-02-10 16:16:16,022 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:16:16,023 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:16:16,036 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] starting
2015-02-10 16:16:16,036 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] source: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:16,037 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] sink: Hfs["TextDelimited[['notnull', 'null']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/countnullnotnull"]
2015-02-10 16:16:16,037 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] parallel execution is enabled: false
2015-02-10 16:16:16,037 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] starting jobs: 1
2015-02-10 16:16:16,037 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] allocating threads: 1
2015-02-10 16:16:16,039 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] starting step: (1/1) ...platform/countnullnotnull
2015-02-10 16:16:16,048 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:16,075 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] submitted hadoop job: job_local_0039
2015-02-10 16:16:16,076 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] tracking url: http://localhost:8080/
2015-02-10 16:16:16,079 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@7685dfcf
2015-02-10 16:16:16,080 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt
2015-02-10 16:16:16,082 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2015-02-10 16:16:16,082 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2015-02-10 16:16:16,106 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2015-02-10 16:16:16,106 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2015-02-10 16:16:16,108 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:16:16,108 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:16:16,114 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt"]
2015-02-10 16:16:16,114 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(count)[by:[{?}:NONE]]
2015-02-10 16:16:16,115 INFO assembly.AggregateBy (AggregateBy.java:prepare(267)) - using threshold value: 2
2015-02-10 16:16:16,120 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2015-02-10 16:16:16,122 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2015-02-10 16:16:16,124 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0039_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:16,125 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/classes/test/data/lhs.txt:0+52
2015-02-10 16:16:16,125 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0039_m_000000_0' done.
2015-02-10 16:16:16,128 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@5abbfa4c
2015-02-10 16:16:16,129 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:16,130 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2015-02-10 16:16:16,131 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 10 bytes
2015-02-10 16:16:16,131 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:16,132 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:16:16,132 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:16:16,138 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(count)[by:[{?}:NONE]]
2015-02-10 16:16:16,138 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['notnull', 'null']]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/countnullnotnull"]
2015-02-10 16:16:16,142 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local_0039_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:16:16,142 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) -
2015-02-10 16:16:16,143 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local_0039_r_000000_0 is allowed to commit now
2015-02-10 16:16:16,145 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0039_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/countnullnotnull
2015-02-10 16:16:16,146 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(323)) - reduce > reduce
2015-02-10 16:16:16,147 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local_0039_r_000000_0' done.
2015-02-10 16:16:16,149 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output/hadoop/assemblyhelpersplatform/countnullnotnull/_temporary
2015-02-10 16:16:16,158 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:16,166 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:16:16,168 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.1.x/build/test/output//hadoop/assemblyhelpersplatform/countnullnotnull