2015-02-10 16:34:29,601 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(187)) - found 1 test platforms from classpath
2015-02-10 16:34:29,653 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(237)) - installing platform: hadoop
2015-02-10 16:34:29,653 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(238)) - running test: cascading.BasicPipesPlatformTest
2015-02-10 16:34:29,688 INFO hadoop.HadoopPlatform (HadoopPlatform.java:setUp(112)) - not using cluster
2015-02-10 16:34:30,121 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:34:30,123 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:34:30,136 INFO property.AppProps (AppProps.java:getAppID(169)) - using app.id: 1B3D2B59B3EB426BACF2EF9FCE7D24A5
2015-02-10 16:34:30,394 INFO util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 2.6.3
2015-02-10 16:34:30,397 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] starting
2015-02-10 16:34:30,398 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] source: Hfs["TextLine[[0:1]->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/apache.10.txt"]
2015-02-10 16:34:30,398 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/simplechain"]
2015-02-10 16:34:30,399 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] parallel execution is enabled: false
2015-02-10 16:34:30,399 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] starting jobs: 2
2015-02-10 16:34:30,399 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] allocating threads: 1
2015-02-10 16:34:30,401 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] starting step: (1/2)
2015-02-10 16:34:30,452 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(52)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2015-02-10 16:34:30,526 WARN snappy.LoadSnappy (LoadSnappy.java:<clinit>(46)) - Snappy native library not loaded
2015-02-10 16:34:30,529 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:34:30,782 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] submitted hadoop job: job_local632296332_0001
2015-02-10 16:34:30,784 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] tracking url: http://localhost:8080/
2015-02-10 16:34:30,817 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(340)) - Waiting for map tasks
2015-02-10 16:34:30,822 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(204)) - Starting task: attempt_local632296332_0001_m_000000_0
2015-02-10 16:34:30,895 INFO util.ProcessTree (ProcessTree.java:isSetsidSupported(63)) - setsid exited with exit code 0
2015-02-10 16:34:30,904 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@56a75737
2015-02-10 16:34:30,912 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/apache.10.txt
2015-02-10 16:34:30,913 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(455)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@29a220e6
2015-02-10 16:34:30,920 INFO mapred.MapTask (MapTask.java:runOldMapper(419)) - numReduceTasks: 1
2015-02-10 16:34:30,929 INFO mapred.MapTask (MapTask.java:<init>(949)) - io.sort.mb = 100
2015-02-10 16:34:31,092 INFO mapred.MapTask (MapTask.java:<init>(961)) - data buffer = 79691776/99614720
2015-02-10 16:34:31,093 INFO mapred.MapTask (MapTask.java:<init>(962)) - record buffer = 262144/327680
2015-02-10 16:34:31,118 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:34:31,118 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:34:31,192 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[[0:1]->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/apache.10.txt"]
2015-02-10 16:34:31,192 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(test)[by:[{1}:0]]
2015-02-10 16:34:31,206 INFO mapred.MapTask (MapTask.java:flush(1289)) - Starting flush of map output
2015-02-10 16:34:31,220 INFO mapred.MapTask (MapTask.java:sortAndSpill(1471)) - Finished spill 0
2015-02-10 16:34:31,223 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local632296332_0001_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:34:31,229 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/apache.10.txt:0+1449
2015-02-10 16:34:31,229 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local632296332_0001_m_000000_0' done.
2015-02-10 16:34:31,229 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(229)) - Finishing task: attempt_local632296332_0001_m_000000_0
2015-02-10 16:34:31,230 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(348)) - Map task executor complete.
2015-02-10 16:34:31,241 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@3d3c33b7
2015-02-10 16:34:31,242 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) -
2015-02-10 16:34:31,247 INFO mapred.Merger (Merger.java:merge(408)) - Merging 1 sorted segments
2015-02-10 16:34:31,254 INFO mapred.Merger (Merger.java:merge(491)) - Down to the last merge-pass, with 1 segments left of total size: 232 bytes
2015-02-10 16:34:31,254 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) -
2015-02-10 16:34:31,256 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:34:31,256 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:34:31,276 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(test)[by:[{1}:0]]
2015-02-10 16:34:31,276 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: TempHfs["SequenceFile[[0, 'count']]"][8532788106/test/]
2015-02-10 16:34:31,302 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local632296332_0001_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:34:31,304 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) -
2015-02-10 16:34:31,304 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local632296332_0001_r_000000_0 is allowed to commit now
2015-02-10 16:34:31,308 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local632296332_0001_r_000000_0' to file:/tmp/hadoop-teamcity/8532788106_test_E5F71216CF3A4BC8877FFCCFD265EBB3
2015-02-10 16:34:31,310 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) - reduce > reduce
2015-02-10 16:34:31,310 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local632296332_0001_r_000000_0' done.
2015-02-10 16:34:31,321 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] starting step: (2/2) ...pipesplatform/simplechain
2015-02-10 16:34:31,339 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:34:31,440 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] submitted hadoop job: job_local447133466_0002
2015-02-10 16:34:31,441 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] tracking url: http://localhost:8080/
2015-02-10 16:34:31,444 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(340)) - Waiting for map tasks
2015-02-10 16:34:31,444 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(204)) - Starting task: attempt_local447133466_0002_m_000000_0
2015-02-10 16:34:31,448 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@647fc8b2
2015-02-10 16:34:31,450 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-teamcity/8532788106_test_E5F71216CF3A4BC8877FFCCFD265EBB3/part-00000
2015-02-10 16:34:31,451 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(455)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@5484ff20
2015-02-10 16:34:31,459 INFO mapred.MapTask (MapTask.java:runOldMapper(419)) - numReduceTasks: 1
2015-02-10 16:34:31,460 INFO mapred.MapTask (MapTask.java:<init>(949)) - io.sort.mb = 100
2015-02-10 16:34:31,601 INFO mapred.MapTask (MapTask.java:<init>(961)) - data buffer = 79691776/99614720
2015-02-10 16:34:31,602 INFO mapred.MapTask (MapTask.java:<init>(962)) - record buffer = 262144/327680
2015-02-10 16:34:31,604 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:34:31,605 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:34:31,620 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: TempHfs["SequenceFile[[0, 'count']]"][8532788106/test/]
2015-02-10 16:34:31,621 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(test)[by:[{1}:0]]
2015-02-10 16:34:31,624 INFO mapred.MapTask (MapTask.java:flush(1289)) - Starting flush of map output
2015-02-10 16:34:31,629 INFO mapred.MapTask (MapTask.java:sortAndSpill(1471)) - Finished spill 0
2015-02-10 16:34:31,632 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local447133466_0002_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:34:31,635 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) - file:/tmp/hadoop-teamcity/8532788106_test_E5F71216CF3A4BC8877FFCCFD265EBB3/part-00000:0+310
2015-02-10 16:34:31,636 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local447133466_0002_m_000000_0' done.
2015-02-10 16:34:31,637 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(229)) - Finishing task: attempt_local447133466_0002_m_000000_0
2015-02-10 16:34:31,637 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(348)) - Map task executor complete.
2015-02-10 16:34:31,643 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@4d74f02c
2015-02-10 16:34:31,644 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) -
2015-02-10 16:34:31,645 INFO mapred.Merger (Merger.java:merge(408)) - Merging 1 sorted segments
2015-02-10 16:34:31,645 INFO mapred.Merger (Merger.java:merge(491)) - Down to the last merge-pass, with 1 segments left of total size: 202 bytes
2015-02-10 16:34:31,646 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) -
2015-02-10 16:34:31,647 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:34:31,647 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:34:31,658 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(test)[by:[{1}:0]]
2015-02-10 16:34:31,658 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/simplechain"]
2015-02-10 16:34:31,668 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local447133466_0002_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:34:31,670 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) -
2015-02-10 16:34:31,670 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local447133466_0002_r_000000_0 is allowed to commit now
2015-02-10 16:34:31,675 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local447133466_0002_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/simplechain
2015-02-10 16:34:31,676 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) - reduce > reduce
2015-02-10 16:34:31,676 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local447133466_0002_r_000000_0' done.
2015-02-10 16:34:31,688 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/simplechain/_temporary
2015-02-10 16:34:31,712 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:34:31,714 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output//hadoop/basicpipesplatform/simplechain
2015-02-10 16:34:31,740 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:34:31,740 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:34:31,772 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] starting
2015-02-10 16:34:31,772 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] source: Hfs["TextLine[[0:1]->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/ips.20.txt"]
2015-02-10 16:34:31,773 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] sink: Hfs["TextLine[[0]->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/count"]
2015-02-10 16:34:31,773 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] parallel execution is enabled: false
2015-02-10 16:34:31,773 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] starting jobs: 1
2015-02-10 16:34:31,773 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] allocating threads: 1
2015-02-10 16:34:31,774 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] starting step: (1/1) .../basicpipesplatform/count
2015-02-10 16:34:31,792 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:34:31,860 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] submitted hadoop job: job_local1031118827_0003
2015-02-10 16:34:31,860 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] tracking url: http://localhost:8080/
2015-02-10 16:34:31,863 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(340)) - Waiting for map tasks
2015-02-10 16:34:31,863 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(204)) - Starting task: attempt_local1031118827_0003_m_000000_0
2015-02-10 16:34:31,865 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@3166aab6
2015-02-10 16:34:31,867 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/ips.20.txt
2015-02-10 16:34:31,867 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(455)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@1a3526cf
2015-02-10 16:34:31,869 INFO mapred.MapTask (MapTask.java:runOldMapper(419)) - numReduceTasks: 1
2015-02-10 16:34:31,869 INFO mapred.MapTask (MapTask.java:<init>(949)) - io.sort.mb = 100
2015-02-10 16:34:32,013 INFO mapred.MapTask (MapTask.java:<init>(961)) - data buffer = 79691776/99614720
2015-02-10 16:34:32,014 INFO mapred.MapTask (MapTask.java:<init>(962)) - record buffer = 262144/327680
2015-02-10 16:34:32,015 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:34:32,015 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:34:32,026 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[[0:1]->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/ips.20.txt"]
2015-02-10 16:34:32,027 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(count)[by:[{1}:1]]
2015-02-10 16:34:32,031 INFO mapred.MapTask (MapTask.java:flush(1289)) - Starting flush of map output
2015-02-10 16:34:32,038 INFO mapred.MapTask (MapTask.java:sortAndSpill(1471)) - Finished spill 0
2015-02-10 16:34:32,040 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local1031118827_0003_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:34:32,043 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/ips.20.txt:0+275
2015-02-10 16:34:32,043 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local1031118827_0003_m_000000_0' done.
2015-02-10 16:34:32,043 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(229)) - Finishing task: attempt_local1031118827_0003_m_000000_0
2015-02-10 16:34:32,043 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(348)) - Map task executor complete.
2015-02-10 16:34:32,048 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@1c8321c8
2015-02-10 16:34:32,049 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) -
2015-02-10 16:34:32,050 INFO mapred.Merger (Merger.java:merge(408)) - Merging 1 sorted segments
2015-02-10 16:34:32,051 INFO mapred.Merger (Merger.java:merge(491)) - Down to the last merge-pass, with 1 segments left of total size: 508 bytes
2015-02-10 16:34:32,051 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) -
2015-02-10 16:34:32,052 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:34:32,052 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:34:32,064 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(count)[by:[{1}:1]]
2015-02-10 16:34:32,064 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[[0]->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/count"]
2015-02-10 16:34:32,075 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local1031118827_0003_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:34:32,077 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) -
2015-02-10 16:34:32,077 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local1031118827_0003_r_000000_0 is allowed to commit now
2015-02-10 16:34:32,081 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local1031118827_0003_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/count
2015-02-10 16:34:32,083 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) - reduce > reduce
2015-02-10 16:34:32,083 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local1031118827_0003_r_000000_0' done.
2015-02-10 16:34:32,094 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/count/_temporary
2015-02-10 16:34:32,108 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:34:32,124 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:34:32,127 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output//hadoop/basicpipesplatform/count
2015-02-10 16:34:32,141 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:34:32,142 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:34:32,164 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] starting
2015-02-10 16:34:32,165 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] source: Hfs["TextLine[[0:1]->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/apache.10.txt"]
2015-02-10 16:34:32,165 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/swap"]
2015-02-10 16:34:32,165 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] parallel execution is enabled: false
2015-02-10 16:34:32,165 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] starting jobs: 1
2015-02-10 16:34:32,165 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] allocating threads: 1
2015-02-10 16:34:32,166 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] starting step: (1/1) ...p/basicpipesplatform/swap
2015-02-10 16:34:32,183 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:34:32,226 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] submitted hadoop job: job_local1670811441_0004
2015-02-10 16:34:32,226 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] tracking url: http://localhost:8080/
2015-02-10 16:34:32,228 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(340)) - Waiting for map tasks
2015-02-10 16:34:32,229 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(204)) - Starting task: attempt_local1670811441_0004_m_000000_0
2015-02-10 16:34:32,230 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@661eef2c
2015-02-10 16:34:32,232 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/apache.10.txt
2015-02-10 16:34:32,233 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(455)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@213a8eb1
2015-02-10 16:34:32,234 INFO mapred.MapTask (MapTask.java:runOldMapper(419)) - numReduceTasks: 0
2015-02-10 16:34:32,240 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:34:32,241 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:34:32,251 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[[0:1]->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/apache.10.txt"]
2015-02-10 16:34:32,252 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/swap"]
2015-02-10 16:34:32,256 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local1670811441_0004_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:34:32,259 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) -
2015-02-10 16:34:32,260 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local1670811441_0004_m_000000_0 is allowed to commit now
2015-02-10 16:34:32,264 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local1670811441_0004_m_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/swap
2015-02-10 16:34:32,266 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/apache.10.txt:0+1449
2015-02-10 16:34:32,267 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local1670811441_0004_m_000000_0' done.
2015-02-10 16:34:32,267 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(229)) - Finishing task: attempt_local1670811441_0004_m_000000_0
2015-02-10 16:34:32,268 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(348)) - Map task executor complete.
2015-02-10 16:34:32,278 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/swap/_temporary
2015-02-10 16:34:32,291 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:34:32,294 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output//hadoop/basicpipesplatform/swap
2015-02-10 16:34:32,310 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:34:32,311 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:34:32,334 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] starting
2015-02-10 16:34:32,335 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] source: Hfs["TextLine[[0:1]->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/lower+upper.txt"]
2015-02-10 16:34:32,335 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/ungrouped"]
2015-02-10 16:34:32,335 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] parallel execution is enabled: false
2015-02-10 16:34:32,335 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] starting jobs: 1
2015-02-10 16:34:32,335 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] allocating threads: 1
2015-02-10 16:34:32,336 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] starting step: (1/1) ...icpipesplatform/ungrouped
2015-02-10 16:34:32,358 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:34:32,396 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] submitted hadoop job: job_local1476909410_0005
2015-02-10 16:34:32,397 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] tracking url: http://localhost:8080/
2015-02-10 16:34:32,399 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(340)) - Waiting for map tasks
2015-02-10 16:34:32,400 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(204)) - Starting task: attempt_local1476909410_0005_m_000000_0
2015-02-10 16:34:32,402 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@18a4edc4
2015-02-10 16:34:32,404 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/lower+upper.txt
2015-02-10 16:34:32,405 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(455)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@3b500efd
2015-02-10 16:34:32,407 INFO mapred.MapTask (MapTask.java:runOldMapper(419)) - numReduceTasks: 0
2015-02-10 16:34:32,412 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:34:32,412 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:34:32,423 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[[0:1]->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/lower+upper.txt"]
2015-02-10 16:34:32,423 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/ungrouped"]
2015-02-10 16:34:32,426 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local1476909410_0005_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:34:32,428 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) -
2015-02-10 16:34:32,428 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local1476909410_0005_m_000000_0 is allowed to commit now
2015-02-10 16:34:32,432 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local1476909410_0005_m_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/ungrouped
2015-02-10 16:34:32,434 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/lower+upper.txt:0+30
2015-02-10 16:34:32,434 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local1476909410_0005_m_000000_0' done.
2015-02-10 16:34:32,434 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(229)) - Finishing task: attempt_local1476909410_0005_m_000000_0
2015-02-10 16:34:32,434 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(348)) - Map task executor complete.
2015-02-10 16:34:32,449 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/ungrouped/_temporary
2015-02-10 16:34:32,461 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:34:32,463 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output//hadoop/basicpipesplatform/ungrouped
2015-02-10 16:34:32,479 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:34:32,479 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:34:32,505 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] starting
2015-02-10 16:34:32,505 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] source: Hfs["TextLine[[0:1]->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/apache.10.txt"]
2015-02-10 16:34:32,507 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/simplerelative"]
2015-02-10 16:34:32,507 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] parallel execution is enabled: false
2015-02-10 16:34:32,507 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] starting jobs: 1
2015-02-10 16:34:32,508 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] allocating threads: 1
2015-02-10 16:34:32,508 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] starting step: (1/1) ...esplatform/simplerelative
2015-02-10 16:34:32,523 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:34:32,561 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] submitted hadoop job: job_local1336808948_0006
2015-02-10 16:34:32,561 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] tracking url: http://localhost:8080/
2015-02-10 16:34:32,564 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(340)) - Waiting for map tasks
2015-02-10 16:34:32,565 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(204)) - Starting task: attempt_local1336808948_0006_m_000000_0
2015-02-10 16:34:32,567 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@78f6e005
2015-02-10 16:34:32,568 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/apache.10.txt
2015-02-10 16:34:32,568 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(455)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@223dc13d
2015-02-10 16:34:32,570 INFO mapred.MapTask (MapTask.java:runOldMapper(419)) - numReduceTasks: 1
2015-02-10 16:34:32,570 INFO mapred.MapTask (MapTask.java:<init>(949)) - io.sort.mb = 100
2015-02-10 16:34:32,705 INFO mapred.MapTask (MapTask.java:<init>(961)) - data buffer = 79691776/99614720
2015-02-10 16:34:32,705 INFO mapred.MapTask (MapTask.java:<init>(962)) - record buffer = 262144/327680
2015-02-10 16:34:32,707 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:34:32,707 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:34:32,717 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[[0:1]->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/apache.10.txt"]
2015-02-10 16:34:32,717 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(test)[by:[{1}:0]]
2015-02-10 16:34:32,721 INFO mapred.MapTask (MapTask.java:flush(1289)) - Starting flush of map output
2015-02-10 16:34:32,724 INFO mapred.MapTask (MapTask.java:sortAndSpill(1471)) - Finished spill 0
2015-02-10 16:34:32,727 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local1336808948_0006_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:34:32,729 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/apache.10.txt:0+1449
2015-02-10 16:34:32,729 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local1336808948_0006_m_000000_0' done.
2015-02-10 16:34:32,730 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(229)) - Finishing task: attempt_local1336808948_0006_m_000000_0
2015-02-10 16:34:32,730 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(348)) - Map task executor complete.
2015-02-10 16:34:32,735 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@4b17b450
2015-02-10 16:34:32,735 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) -
2015-02-10 16:34:32,736 INFO mapred.Merger (Merger.java:merge(408)) - Merging 1 sorted segments
2015-02-10 16:34:32,737 INFO mapred.Merger (Merger.java:merge(491)) - Down to the last merge-pass, with 1 segments left of total size: 232 bytes
2015-02-10 16:34:32,738 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) -
2015-02-10 16:34:32,738 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:34:32,738 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:34:32,748 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(test)[by:[{1}:0]]
2015-02-10 16:34:32,750 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/simplerelative"]
2015-02-10 16:34:32,760 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local1336808948_0006_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:34:32,762 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) -
2015-02-10 16:34:32,762 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local1336808948_0006_r_000000_0 is allowed to commit now
2015-02-10 16:34:32,766 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local1336808948_0006_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/simplerelative
2015-02-10 16:34:32,768 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) - reduce > reduce
2015-02-10 16:34:32,768 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local1336808948_0006_r_000000_0' done.
2015-02-10 16:34:32,780 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/simplerelative/_temporary
2015-02-10 16:34:32,791 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:34:32,793 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output//hadoop/basicpipesplatform/simplerelative
2015-02-10 16:34:33,045 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:34:33,046 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:34:33,086 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] starting
2015-02-10 16:34:33,086 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] source: Hfs["TextLine[[0:1]->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/lower.txt"]
2015-02-10 16:34:33,086 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] sink: Hfs["TextLine[[0]->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/simpleresult"]
2015-02-10 16:34:33,087 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] parallel execution is enabled: false
2015-02-10 16:34:33,087 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] starting jobs: 1
2015-02-10 16:34:33,087 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] allocating threads: 1
2015-02-10 16:34:33,088 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] starting step: (1/1) ...ipesplatform/simpleresult
2015-02-10 16:34:33,104 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:34:33,140 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] submitted hadoop job: job_local1502884313_0007
2015-02-10 16:34:33,141 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] tracking url: http://localhost:8080/
2015-02-10 16:34:33,144 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(340)) - Waiting for map tasks
2015-02-10 16:34:33,144 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(204)) - Starting task: attempt_local1502884313_0007_m_000000_0
2015-02-10 16:34:33,146 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@2a5b8e8c
2015-02-10 16:34:33,148 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/lower.txt
2015-02-10 16:34:33,148 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(455)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@3f78e13f
2015-02-10 16:34:33,149 INFO mapred.MapTask (MapTask.java:runOldMapper(419)) - numReduceTasks: 1
2015-02-10 16:34:33,150 INFO mapred.MapTask (MapTask.java:<init>(949)) - io.sort.mb = 100
2015-02-10 16:34:33,282 INFO mapred.MapTask (MapTask.java:<init>(961)) - data buffer = 79691776/99614720
2015-02-10 16:34:33,283 INFO mapred.MapTask (MapTask.java:<init>(962)) - record buffer = 262144/327680
2015-02-10 16:34:33,284 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:34:33,284 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:34:33,297 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[[0:1]->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/lower.txt"]
2015-02-10 16:34:33,297 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(test)[by:[{1}:0]]
2015-02-10 16:34:33,398 INFO mapred.MapTask (MapTask.java:flush(1289)) - Starting flush of map output
2015-02-10 16:34:33,401 INFO mapred.MapTask (MapTask.java:sortAndSpill(1471)) - Finished spill 0
2015-02-10 16:34:33,403 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local1502884313_0007_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:34:33,406 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/lower.txt:0+19
2015-02-10 16:34:33,406 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local1502884313_0007_m_000000_0' done.
2015-02-10 16:34:33,406 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(229)) - Finishing task: attempt_local1502884313_0007_m_000000_0
2015-02-10 16:34:33,407 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(348)) - Map task executor complete.
2015-02-10 16:34:33,412 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@dc44a6d
2015-02-10 16:34:33,412 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) -
2015-02-10 16:34:33,413 INFO mapred.Merger (Merger.java:merge(408)) - Merging 1 sorted segments
2015-02-10 16:34:33,414 INFO mapred.Merger (Merger.java:merge(491)) - Down to the last merge-pass, with 1 segments left of total size: 28 bytes
2015-02-10 16:34:33,414 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) -
2015-02-10 16:34:33,415 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:34:33,415 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:34:33,426 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(test)[by:[{1}:0]]
2015-02-10 16:34:33,426 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[[0]->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/simpleresult"]
2015-02-10 16:34:33,432 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local1502884313_0007_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:34:33,434 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) -
2015-02-10 16:34:33,434 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local1502884313_0007_r_000000_0 is allowed to commit now
2015-02-10 16:34:33,437 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local1502884313_0007_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/simpleresult
2015-02-10 16:34:33,439 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) - reduce > reduce
2015-02-10 16:34:33,439 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local1502884313_0007_r_000000_0' done.
2015-02-10 16:34:33,450 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/simpleresult/_temporary
2015-02-10 16:34:33,463 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:34:33,464 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output//hadoop/basicpipesplatform/simpleresult
2015-02-10 16:34:33,477 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:34:33,477 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:34:33,496 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] starting
2015-02-10 16:34:33,497 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] source: Hfs["TextLine[[0:1]->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/apache.10.txt"]
2015-02-10 16:34:33,497 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/filterall"]
2015-02-10 16:34:33,497 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] parallel execution is enabled: false
2015-02-10 16:34:33,497 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] starting jobs: 1
2015-02-10 16:34:33,497 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] allocating threads: 1
2015-02-10 16:34:33,499 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] starting step: (1/1) ...icpipesplatform/filterall
2015-02-10 16:34:33,514 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:34:33,550 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] submitted hadoop job: job_local462147875_0008
2015-02-10 16:34:33,551 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] tracking url: http://localhost:8080/
2015-02-10 16:34:33,553 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(340)) - Waiting for map tasks
2015-02-10 16:34:33,553 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(204)) - Starting task: attempt_local462147875_0008_m_000000_0
2015-02-10 16:34:33,555 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@4fadbfde
2015-02-10 16:34:33,557 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/apache.10.txt
2015-02-10 16:34:33,557 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(455)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@dc737be
2015-02-10 16:34:33,559 INFO mapred.MapTask (MapTask.java:runOldMapper(419)) - numReduceTasks: 0
2015-02-10 16:34:33,563 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:34:33,563 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:34:33,571 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[[0:1]->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/apache.10.txt"]
2015-02-10 16:34:33,571 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/filterall"]
2015-02-10 16:34:33,574 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local462147875_0008_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:34:33,576 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) -
2015-02-10 16:34:33,577 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local462147875_0008_m_000000_0 is allowed to commit now
2015-02-10 16:34:33,580 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local462147875_0008_m_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/filterall
2015-02-10 16:34:33,581 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/apache.10.txt:0+1449
2015-02-10 16:34:33,582 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local462147875_0008_m_000000_0' done.
2015-02-10 16:34:33,582 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(229)) - Finishing task: attempt_local462147875_0008_m_000000_0
2015-02-10 16:34:33,582 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(348)) - Map task executor complete.
2015-02-10 16:34:33,594 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/filterall/_temporary
2015-02-10 16:34:33,628 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:34:33,630 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output//hadoop/basicpipesplatform/filterall
2015-02-10 16:34:33,645 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:34:33,645 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:34:33,678 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-02-10 16:34:33,679 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextLine[[0:1]->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/upper.txt"]
2015-02-10 16:34:33,679 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextLine[[0:1]->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/lower.txt"]
2015-02-10 16:34:33,679 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] sink: Hfs["TextLine[[0]->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/complexcogroup"]
2015-02-10 16:34:33,679 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] parallel execution is enabled: false
2015-02-10 16:34:33,680 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting jobs: 1
2015-02-10 16:34:33,680 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] allocating threads: 1
2015-02-10 16:34:33,680 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/1) ...esplatform/complexcogroup
2015-02-10 16:34:33,694 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:34:33,696 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:34:33,724 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_local1123548179_0009
2015-02-10 16:34:33,724 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://localhost:8080/
2015-02-10 16:34:33,728 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(340)) - Waiting for map tasks
2015-02-10 16:34:33,728 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(204)) - Starting task: attempt_local1123548179_0009_m_000000_0
2015-02-10 16:34:33,730 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@29747e0f
2015-02-10 16:34:33,731 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/lower.txt
2015-02-10 16:34:33,731 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(455)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@6a74f160
2015-02-10 16:34:33,733 INFO mapred.MapTask (MapTask.java:runOldMapper(419)) - numReduceTasks: 1
2015-02-10 16:34:33,733 INFO mapred.MapTask (MapTask.java:<init>(949)) - io.sort.mb = 100
2015-02-10 16:34:34,107 INFO mapred.MapTask (MapTask.java:<init>(961)) - data buffer = 79691776/99614720
2015-02-10 16:34:34,108 INFO mapred.MapTask (MapTask.java:<init>(962)) - record buffer = 262144/327680
2015-02-10 16:34:34,112 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:34:34,112 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:34:34,123 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[[0:1]->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/lower.txt"]
2015-02-10 16:34:34,123 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: CoGroup(lower*upper)[by: lower:[{1}:0] upper:[{1}:0]]
2015-02-10 16:34:34,126 INFO mapred.MapTask (MapTask.java:flush(1289)) - Starting flush of map output
2015-02-10 16:34:34,128 INFO mapred.MapTask (MapTask.java:sortAndSpill(1471)) - Finished spill 0
2015-02-10 16:34:34,130 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local1123548179_0009_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:34:34,133 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/lower.txt:0+19
2015-02-10 16:34:34,133 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local1123548179_0009_m_000000_0' done.
2015-02-10 16:34:34,133 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(229)) - Finishing task: attempt_local1123548179_0009_m_000000_0
2015-02-10 16:34:34,133 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(204)) - Starting task: attempt_local1123548179_0009_m_000001_0
2015-02-10 16:34:34,135 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@f0fba68
2015-02-10 16:34:34,136 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/upper.txt
2015-02-10 16:34:34,136 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(455)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@6ac27081
2015-02-10 16:34:34,138 INFO mapred.MapTask (MapTask.java:runOldMapper(419)) - numReduceTasks: 1
2015-02-10 16:34:34,138 INFO mapred.MapTask (MapTask.java:<init>(949)) - io.sort.mb = 100
2015-02-10 16:34:34,279 INFO mapred.MapTask (MapTask.java:<init>(961)) - data buffer = 79691776/99614720
2015-02-10 16:34:34,279 INFO mapred.MapTask (MapTask.java:<init>(962)) - record buffer = 262144/327680
2015-02-10 16:34:34,280 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:34:34,281 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:34:34,290 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[[0:1]->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/upper.txt"]
2015-02-10 16:34:34,291 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: CoGroup(lower*upper)[by: lower:[{1}:0] upper:[{1}:0]]
2015-02-10 16:34:34,293 INFO mapred.MapTask (MapTask.java:flush(1289)) - Starting flush of map output
2015-02-10 16:34:34,295 INFO mapred.MapTask (MapTask.java:sortAndSpill(1471)) - Finished spill 0
2015-02-10 16:34:34,297 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local1123548179_0009_m_000001_0 is done. And is in the process of commiting
2015-02-10 16:34:34,300 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/upper.txt:0+19
2015-02-10 16:34:34,300 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local1123548179_0009_m_000001_0' done.
2015-02-10 16:34:34,300 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(229)) - Finishing task: attempt_local1123548179_0009_m_000001_0
2015-02-10 16:34:34,300 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(348)) - Map task executor complete.
2015-02-10 16:34:34,309 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@32db4c8d
2015-02-10 16:34:34,310 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) -
2015-02-10 16:34:34,311 INFO mapred.Merger (Merger.java:merge(408)) - Merging 2 sorted segments
2015-02-10 16:34:34,312 INFO mapred.Merger (Merger.java:merge(491)) - Down to the last merge-pass, with 2 segments left of total size: 194 bytes
2015-02-10 16:34:34,313 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) -
2015-02-10 16:34:34,313 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:34:34,313 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:34:34,321 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: CoGroup(lower*upper)[by: lower:[{1}:0] upper:[{1}:0]]
2015-02-10 16:34:34,321 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[[0]->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/complexcogroup"]
2015-02-10 16:34:34,333 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-02-10 16:34:34,333 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2015-02-10 16:34:34,341 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local1123548179_0009_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:34:34,343 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) -
2015-02-10 16:34:34,343 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local1123548179_0009_r_000000_0 is allowed to commit now
2015-02-10 16:34:34,346 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local1123548179_0009_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/complexcogroup
2015-02-10 16:34:34,347 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) - reduce > reduce
2015-02-10 16:34:34,348 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local1123548179_0009_r_000000_0' done.
2015-02-10 16:34:34,362 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/complexcogroup/_temporary
2015-02-10 16:34:34,374 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:34:34,386 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:34:34,388 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output//hadoop/basicpipesplatform/complexcogroup
2015-02-10 16:34:34,403 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:34:34,404 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:34:34,421 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] starting
2015-02-10 16:34:34,422 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] source: Hfs["TextLine[[0:1]->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/apache.10.txt"]
2015-02-10 16:34:34,422 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/replace"]
2015-02-10 16:34:34,422 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] parallel execution is enabled: false
2015-02-10 16:34:34,423 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] starting jobs: 1
2015-02-10 16:34:34,423 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] allocating threads: 1
2015-02-10 16:34:34,423 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] starting step: (1/1) ...asicpipesplatform/replace
2015-02-10 16:34:34,436 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:34:34,462 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] submitted hadoop job: job_local1673553478_0010
2015-02-10 16:34:34,463 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] tracking url: http://localhost:8080/
2015-02-10 16:34:34,465 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(340)) - Waiting for map tasks
2015-02-10 16:34:34,465 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(204)) - Starting task: attempt_local1673553478_0010_m_000000_0
2015-02-10 16:34:34,467 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@239b0124
2015-02-10 16:34:34,469 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/apache.10.txt
2015-02-10 16:34:34,469 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(455)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@4eb55c7f
2015-02-10 16:34:34,470 INFO mapred.MapTask (MapTask.java:runOldMapper(419)) - numReduceTasks: 0
2015-02-10 16:34:34,474 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:34:34,474 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:34:34,480 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[[0:1]->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/apache.10.txt"]
2015-02-10 16:34:34,481 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/replace"]
2015-02-10 16:34:34,483 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local1673553478_0010_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:34:34,485 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) -
2015-02-10 16:34:34,486 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local1673553478_0010_m_000000_0 is allowed to commit now
2015-02-10 16:34:34,489 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local1673553478_0010_m_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/replace
2015-02-10 16:34:34,490 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/apache.10.txt:0+1449
2015-02-10 16:34:34,490 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local1673553478_0010_m_000000_0' done.
2015-02-10 16:34:34,491 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(229)) - Finishing task: attempt_local1673553478_0010_m_000000_0
2015-02-10 16:34:34,491 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(348)) - Map task executor complete.
2015-02-10 16:34:34,505 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/replace/_temporary
2015-02-10 16:34:34,518 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:34:34,520 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output//hadoop/basicpipesplatform/replace
2015-02-10 16:34:34,533 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:34:34,534 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:34:34,553 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] starting
2015-02-10 16:34:34,553 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] source: Hfs["TextLine[[0:1]->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/ips.20.txt"]
2015-02-10 16:34:34,554 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] sink: Hfs["TextLine[[0]->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/count2"]
2015-02-10 16:34:34,554 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] parallel execution is enabled: false
2015-02-10 16:34:34,555 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] starting jobs: 1
2015-02-10 16:34:34,555 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] allocating threads: 1
2015-02-10 16:34:34,556 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] starting step: (1/1) ...basicpipesplatform/count2
2015-02-10 16:34:34,568 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:34:34,595 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] submitted hadoop job: job_local295882533_0011
2015-02-10 16:34:34,595 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] tracking url: http://localhost:8080/
2015-02-10 16:34:34,609 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(340)) - Waiting for map tasks
2015-02-10 16:34:34,609 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(204)) - Starting task: attempt_local295882533_0011_m_000000_0
2015-02-10 16:34:34,612 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@45e881b6
2015-02-10 16:34:34,614 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/ips.20.txt
2015-02-10 16:34:34,614 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(455)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@6ee964fe
2015-02-10 16:34:34,616 INFO mapred.MapTask (MapTask.java:runOldMapper(419)) - numReduceTasks: 1
2015-02-10 16:34:34,617 INFO mapred.MapTask (MapTask.java:<init>(949)) - io.sort.mb = 100
2015-02-10 16:34:34,764 INFO mapred.MapTask (MapTask.java:<init>(961)) - data buffer = 79691776/99614720
2015-02-10 16:34:34,764 INFO mapred.MapTask (MapTask.java:<init>(962)) - record buffer = 262144/327680
2015-02-10 16:34:34,767 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:34:34,767 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:34:34,776 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[[0:1]->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/ips.20.txt"]
2015-02-10 16:34:34,776 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(count)[by:[{1}:1]]
2015-02-10 16:34:34,780 INFO mapred.MapTask (MapTask.java:flush(1289)) - Starting flush of map output
2015-02-10 16:34:34,785 INFO mapred.MapTask (MapTask.java:sortAndSpill(1471)) - Finished spill 0
2015-02-10 16:34:34,788 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local295882533_0011_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:34:34,791 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/ips.20.txt:0+275
2015-02-10 16:34:34,791 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local295882533_0011_m_000000_0' done.
2015-02-10 16:34:34,792 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(229)) - Finishing task: attempt_local295882533_0011_m_000000_0
2015-02-10 16:34:34,793 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(348)) - Map task executor complete.
2015-02-10 16:34:34,797 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@730a4a32
2015-02-10 16:34:34,798 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) -
2015-02-10 16:34:34,799 INFO mapred.Merger (Merger.java:merge(408)) - Merging 1 sorted segments
2015-02-10 16:34:34,799 INFO mapred.Merger (Merger.java:merge(491)) - Down to the last merge-pass, with 1 segments left of total size: 508 bytes
2015-02-10 16:34:34,800 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) -
2015-02-10 16:34:34,800 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:34:34,800 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:34:34,808 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(count)[by:[{1}:1]]
2015-02-10 16:34:34,808 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[[0]->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/count2"]
2015-02-10 16:34:34,817 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local295882533_0011_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:34:34,818 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) -
2015-02-10 16:34:34,819 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local295882533_0011_r_000000_0 is allowed to commit now
2015-02-10 16:34:34,822 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local295882533_0011_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/count2
2015-02-10 16:34:34,823 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) - reduce > reduce
2015-02-10 16:34:34,824 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local295882533_0011_r_000000_0' done.
2015-02-10 16:34:34,837 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/count2/_temporary
2015-02-10 16:34:34,849 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:34:34,912 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:34:34,915 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output//hadoop/basicpipesplatform/count2
2015-02-10 16:34:34,930 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:34:34,931 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:34:34,957 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] starting
2015-02-10 16:34:34,957 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] source: Hfs["TextLine[[0:1]->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/ips.20.txt"]
2015-02-10 16:34:34,958 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] sink: Hfs["TextLine[[0]->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/count3"]
2015-02-10 16:34:34,958 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] parallel execution is enabled: false
2015-02-10 16:34:34,958 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] starting jobs: 1
2015-02-10 16:34:34,958 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] allocating threads: 1
2015-02-10 16:34:34,959 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] starting step: (1/1) ...basicpipesplatform/count3
2015-02-10 16:34:34,971 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:34:35,003 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] submitted hadoop job: job_local15630586_0012
2015-02-10 16:34:35,003 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] tracking url: http://localhost:8080/
2015-02-10 16:34:35,006 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(340)) - Waiting for map tasks
2015-02-10 16:34:35,006 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(204)) - Starting task: attempt_local15630586_0012_m_000000_0
2015-02-10 16:34:35,008 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@502a3135
2015-02-10 16:34:35,010 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/ips.20.txt
2015-02-10 16:34:35,010 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(455)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@13a9192b
2015-02-10 16:34:35,011 INFO mapred.MapTask (MapTask.java:runOldMapper(419)) - numReduceTasks: 1
2015-02-10 16:34:35,012 INFO mapred.MapTask (MapTask.java:<init>(949)) - io.sort.mb = 100
2015-02-10 16:34:35,154 INFO mapred.MapTask (MapTask.java:<init>(961)) - data buffer = 79691776/99614720
2015-02-10 16:34:35,155 INFO mapred.MapTask (MapTask.java:<init>(962)) - record buffer = 262144/327680
2015-02-10 16:34:35,158 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:34:35,158 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:34:35,165 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[[0:1]->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/ips.20.txt"]
2015-02-10 16:34:35,165 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(count)[by:[{1}:1]]
2015-02-10 16:34:35,169 INFO mapred.MapTask (MapTask.java:flush(1289)) - Starting flush of map output
2015-02-10 16:34:35,173 INFO mapred.MapTask (MapTask.java:sortAndSpill(1471)) - Finished spill 0
2015-02-10 16:34:35,175 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local15630586_0012_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:34:35,178 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/ips.20.txt:0+275
2015-02-10 16:34:35,178 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local15630586_0012_m_000000_0' done.
2015-02-10 16:34:35,178 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(229)) - Finishing task: attempt_local15630586_0012_m_000000_0
2015-02-10 16:34:35,179 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(348)) - Map task executor complete.
2015-02-10 16:34:35,183 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@3cecfaea
2015-02-10 16:34:35,184 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) -
2015-02-10 16:34:35,185 INFO mapred.Merger (Merger.java:merge(408)) - Merging 1 sorted segments
2015-02-10 16:34:35,185 INFO mapred.Merger (Merger.java:merge(491)) - Down to the last merge-pass, with 1 segments left of total size: 508 bytes
2015-02-10 16:34:35,186 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) -
2015-02-10 16:34:35,187 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:34:35,187 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:34:35,194 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(count)[by:[{1}:1]]
2015-02-10 16:34:35,195 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[[0]->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/count3"]
2015-02-10 16:34:35,204 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local15630586_0012_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:34:35,205 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) -
2015-02-10 16:34:35,206 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local15630586_0012_r_000000_0 is allowed to commit now
2015-02-10 16:34:35,208 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local15630586_0012_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/count3
2015-02-10 16:34:35,210 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) - reduce > reduce
2015-02-10 16:34:35,210 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local15630586_0012_r_000000_0' done.
2015-02-10 16:34:35,219 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/count3/_temporary
2015-02-10 16:34:35,230 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:34:35,242 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:34:35,244 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output//hadoop/basicpipesplatform/count3
2015-02-10 16:34:35,256 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:34:35,258 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:34:35,274 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] starting
2015-02-10 16:34:35,275 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] source: Hfs["TextLine[[0:1]->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/ips.20.txt"]
2015-02-10 16:34:35,275 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] sink: Hfs["TextLine[[0]->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/count4"]
2015-02-10 16:34:35,276 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] parallel execution is enabled: false
2015-02-10 16:34:35,276 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] starting jobs: 1
2015-02-10 16:34:35,276 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [count] allocating threads: 1
2015-02-10 16:34:35,277 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] starting step: (1/1) ...basicpipesplatform/count4
2015-02-10 16:34:35,288 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:34:35,313 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] submitted hadoop job: job_local1935428833_0013
2015-02-10 16:34:35,314 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] tracking url: http://localhost:8080/
2015-02-10 16:34:35,317 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(340)) - Waiting for map tasks
2015-02-10 16:34:35,317 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(204)) - Starting task: attempt_local1935428833_0013_m_000000_0
2015-02-10 16:34:35,319 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@74b65a68
2015-02-10 16:34:35,320 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/ips.20.txt
2015-02-10 16:34:35,320 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(455)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@f715510
2015-02-10 16:34:35,322 INFO mapred.MapTask (MapTask.java:runOldMapper(419)) - numReduceTasks: 1
2015-02-10 16:34:35,322 INFO mapred.MapTask (MapTask.java:<init>(949)) - io.sort.mb = 100
2015-02-10 16:34:35,458 INFO mapred.MapTask (MapTask.java:<init>(961)) - data buffer = 79691776/99614720
2015-02-10 16:34:35,459 INFO mapred.MapTask (MapTask.java:<init>(962)) - record buffer = 262144/327680
2015-02-10 16:34:35,460 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:34:35,461 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:34:35,468 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[[0:1]->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/ips.20.txt"]
2015-02-10 16:34:35,469 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(count)[by:[{1}:1]]
2015-02-10 16:34:35,473 INFO mapred.MapTask (MapTask.java:flush(1289)) - Starting flush of map output
2015-02-10 16:34:35,478 INFO mapred.MapTask (MapTask.java:sortAndSpill(1471)) - Finished spill 0
2015-02-10 16:34:35,480 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local1935428833_0013_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:34:35,482 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/ips.20.txt:0+275
2015-02-10 16:34:35,483 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local1935428833_0013_m_000000_0' done.
2015-02-10 16:34:35,483 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(229)) - Finishing task: attempt_local1935428833_0013_m_000000_0
2015-02-10 16:34:35,484 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(348)) - Map task executor complete.
2015-02-10 16:34:35,487 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@a868c6d
2015-02-10 16:34:35,488 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) -
2015-02-10 16:34:35,489 INFO mapred.Merger (Merger.java:merge(408)) - Merging 1 sorted segments
2015-02-10 16:34:35,489 INFO mapred.Merger (Merger.java:merge(491)) - Down to the last merge-pass, with 1 segments left of total size: 508 bytes
2015-02-10 16:34:35,490 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) -
2015-02-10 16:34:35,490 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:34:35,490 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:34:35,497 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(count)[by:[{1}:1]]
2015-02-10 16:34:35,497 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[[0]->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/count4"]
2015-02-10 16:34:35,505 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local1935428833_0013_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:34:35,506 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) -
2015-02-10 16:34:35,506 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local1935428833_0013_r_000000_0 is allowed to commit now
2015-02-10 16:34:35,509 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local1935428833_0013_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/count4
2015-02-10 16:34:35,511 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) - reduce > reduce
2015-02-10 16:34:35,511 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local1935428833_0013_r_000000_0' done.
2015-02-10 16:34:35,518 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/count4/_temporary
2015-02-10 16:34:35,528 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:34:35,538 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:34:35,540 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output//hadoop/basicpipesplatform/count4
2015-02-10 16:34:35,551 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:34:35,551 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:34:35,564 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] starting
2015-02-10 16:34:35,565 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] source: Hfs["TextLine[[0:1]->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/apache.10.txt"]
2015-02-10 16:34:35,566 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/filter"]
2015-02-10 16:34:35,567 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] parallel execution is enabled: false
2015-02-10 16:34:35,568 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] starting jobs: 1
2015-02-10 16:34:35,568 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] allocating threads: 1
2015-02-10 16:34:35,570 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] starting step: (1/1) ...basicpipesplatform/filter
2015-02-10 16:34:35,583 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:34:35,609 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] submitted hadoop job: job_local1317838178_0014
2015-02-10 16:34:35,610 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] tracking url: http://localhost:8080/
2015-02-10 16:34:35,612 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(340)) - Waiting for map tasks
2015-02-10 16:34:35,612 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(204)) - Starting task: attempt_local1317838178_0014_m_000000_0
2015-02-10 16:34:35,613 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@450ae3fb
2015-02-10 16:34:35,615 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/apache.10.txt
2015-02-10 16:34:35,615 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(455)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@24cc17f1
2015-02-10 16:34:35,616 INFO mapred.MapTask (MapTask.java:runOldMapper(419)) - numReduceTasks: 0
2015-02-10 16:34:35,619 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:34:35,619 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:34:35,625 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[[0:1]->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/apache.10.txt"]
2015-02-10 16:34:35,626 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/filter"]
2015-02-10 16:34:35,628 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local1317838178_0014_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:34:35,629 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) -
2015-02-10 16:34:35,630 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local1317838178_0014_m_000000_0 is allowed to commit now
2015-02-10 16:34:35,632 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local1317838178_0014_m_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/filter
2015-02-10 16:34:35,634 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/apache.10.txt:0+1449
2015-02-10 16:34:35,634 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local1317838178_0014_m_000000_0' done.
2015-02-10 16:34:35,634 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(229)) - Finishing task: attempt_local1317838178_0014_m_000000_0
2015-02-10 16:34:35,634 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(348)) - Map task executor complete.
2015-02-10 16:34:35,642 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/filter/_temporary
2015-02-10 16:34:35,653 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:34:35,654 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output//hadoop/basicpipesplatform/filter
2015-02-10 16:34:35,667 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 16:34:35,667 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.6.3/417f6462b56e135b8a02e18f34ce18a2fad9c8c4/cascading-hadoop-2.6.3.jar
2015-02-10 16:34:35,686 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] starting
2015-02-10 16:34:35,686 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] source: Hfs["TextLine[[0:1]->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/apache.10.txt"]
2015-02-10 16:34:35,687 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] sink: Hfs["TextLine[[0]->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/simple"]
2015-02-10 16:34:35,687 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] parallel execution is enabled: false
2015-02-10 16:34:35,687 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] starting jobs: 1
2015-02-10 16:34:35,687 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] allocating threads: 1
2015-02-10 16:34:35,688 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] starting step: (1/1) ...basicpipesplatform/simple
2015-02-10 16:34:35,697 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:34:35,721 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] submitted hadoop job: job_local721006039_0015
2015-02-10 16:34:35,721 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] tracking url: http://localhost:8080/
2015-02-10 16:34:35,724 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(340)) - Waiting for map tasks
2015-02-10 16:34:35,724 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(204)) - Starting task: attempt_local721006039_0015_m_000000_0
2015-02-10 16:34:35,725 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@5999c55a
2015-02-10 16:34:35,727 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/apache.10.txt
2015-02-10 16:34:35,727 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(455)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@71bd8993
2015-02-10 16:34:35,729 INFO mapred.MapTask (MapTask.java:runOldMapper(419)) - numReduceTasks: 1
2015-02-10 16:34:35,729 INFO mapred.MapTask (MapTask.java:<init>(949)) - io.sort.mb = 100
2015-02-10 16:34:36,072 INFO mapred.MapTask (MapTask.java:<init>(961)) - data buffer = 79691776/99614720
2015-02-10 16:34:36,073 INFO mapred.MapTask (MapTask.java:<init>(962)) - record buffer = 262144/327680
2015-02-10 16:34:36,074 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 16:34:36,075 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 16:34:36,084 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[[0:1]->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/apache.10.txt"]
2015-02-10 16:34:36,084 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(test)[by:[{1}:0]]
2015-02-10 16:34:36,087 INFO mapred.MapTask (MapTask.java:flush(1289)) - Starting flush of map output
2015-02-10 16:34:36,090 INFO mapred.MapTask (MapTask.java:sortAndSpill(1471)) - Finished spill 0
2015-02-10 16:34:36,091 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local721006039_0015_m_000000_0 is done. And is in the process of commiting
2015-02-10 16:34:36,093 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/classes/test/data/apache.10.txt:0+1449
2015-02-10 16:34:36,094 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local721006039_0015_m_000000_0' done.
2015-02-10 16:34:36,094 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(229)) - Finishing task: attempt_local721006039_0015_m_000000_0
2015-02-10 16:34:36,094 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(348)) - Map task executor complete.
2015-02-10 16:34:36,097 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@31fc6b2
2015-02-10 16:34:36,098 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) -
2015-02-10 16:34:36,099 INFO mapred.Merger (Merger.java:merge(408)) - Merging 1 sorted segments
2015-02-10 16:34:36,099 INFO mapred.Merger (Merger.java:merge(491)) - Down to the last merge-pass, with 1 segments left of total size: 232 bytes
2015-02-10 16:34:36,100 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) -
2015-02-10 16:34:36,100 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 16:34:36,100 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 16:34:36,108 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(test)[by:[{1}:0]]
2015-02-10 16:34:36,108 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[[0]->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/simple"]
2015-02-10 16:34:36,114 INFO mapred.Task (Task.java:done(858)) - Task:attempt_local721006039_0015_r_000000_0 is done. And is in the process of commiting
2015-02-10 16:34:36,115 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) -
2015-02-10 16:34:36,115 INFO mapred.Task (Task.java:commit(1011)) - Task attempt_local721006039_0015_r_000000_0 is allowed to commit now
2015-02-10 16:34:36,118 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local721006039_0015_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/simple
2015-02-10 16:34:36,119 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(466)) - reduce > reduce
2015-02-10 16:34:36,120 INFO mapred.Task (Task.java:sendDone(970)) - Task 'attempt_local721006039_0015_r_000000_0' done.
2015-02-10 16:34:36,125 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output/hadoop/basicpipesplatform/simple/_temporary
2015-02-10 16:34:36,134 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2015-02-10 16:34:36,136 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-1.2.x/build/test/output//hadoop/basicpipesplatform/simple