2014-04-09 18:39:38,546 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(187)) - found 1 test platforms from classpath
2014-04-09 18:39:38,564 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(237)) - installing platform: hadoop
2014-04-09 18:39:38,564 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(238)) - running test: cascading.RegressionPipesPlatformTest
2014-04-09 18:39:38,577 INFO hadoop.HadoopPlatform (HadoopPlatform.java:setUp(112)) - not using cluster
2014-04-09 18:39:38,769 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 18:39:38,770 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 18:39:38,775 INFO property.AppProps (AppProps.java:getAppID(162)) - using app.id: 9D8022BA57A6443BA4E5DF592FAEECA3
2014-04-09 18:39:38,888 INFO util.Version (Version.java:printBanner(78)) - Concurrent, Inc - Cascading 2.5.3
2014-04-09 18:39:38,889 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] starting
2014-04-09 18:39:38,889 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 18:39:38,890 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] sink: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/regression/complexlogicor"]
2014-04-09 18:39:38,890 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] parallel execution is enabled: false
2014-04-09 18:39:38,890 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] starting jobs: 1
2014-04-09 18:39:38,890 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] allocating threads: 1
2014-04-09 18:39:38,891 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] starting step: (1/1) ...regression/complexlogicor
2014-04-09 18:39:38,911 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(52)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2014-04-09 18:39:38,932 WARN snappy.LoadSnappy (LoadSnappy.java:<clinit>(46)) - Snappy native library not loaded
2014-04-09 18:39:38,934 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 18:39:39,028 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] submitted hadoop job: job_local_0001
2014-04-09 18:39:39,029 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] tracking url: http://localhost:8080/
2014-04-09 18:39:39,057 INFO util.ProcessTree (ProcessTree.java:isSetsidSupported(63)) - setsid exited with exit code 0
2014-04-09 18:39:39,061 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@72ee3d51
2014-04-09 18:39:39,068 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 18:39:39,075 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 0
2014-04-09 18:39:39,083 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 18:39:39,083 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 18:39:39,108 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 18:39:39,108 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/regression/complexlogicor"]
2014-04-09 18:39:39,115 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0001_m_000000_0 is done. And is in the process of commiting
2014-04-09 18:39:39,116 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 18:39:39,116 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0001_m_000000_0 is allowed to commit now
2014-04-09 18:39:39,118 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0001_m_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/regression/complexlogicor
2014-04-09 18:39:42,051 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 18:39:42,052 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0001_m_000000_0' done.
2014-04-09 18:39:42,070 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/regression/complexlogicor/_temporary
2014-04-09 18:39:42,087 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 18:39:42,089 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/regressionpipesplatform/regression/complexlogicor
2014-04-09 18:39:42,102 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 18:39:42,103 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 18:39:42,114 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [split] starting
2014-04-09 18:39:42,115 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [split] source: Hfs["TextLine[['line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt"]
2014-04-09 18:39:42,115 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [split] sink: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/intermediate"]
2014-04-09 18:39:42,115 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [split] parallel execution is enabled: false
2014-04-09 18:39:42,115 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [split] starting jobs: 1
2014-04-09 18:39:42,115 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [split] allocating threads: 1
2014-04-09 18:39:42,116 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [split] starting step: (1/1) ...ipesplatform/intermediate
2014-04-09 18:39:42,123 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 18:39:42,160 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [split] submitted hadoop job: job_local_0002
2014-04-09 18:39:42,160 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [split] tracking url: http://localhost:8080/
2014-04-09 18:39:42,162 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@710ec7e6
2014-04-09 18:39:42,163 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt
2014-04-09 18:39:42,164 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 0
2014-04-09 18:39:42,166 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 18:39:42,167 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 18:39:42,173 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt"]
2014-04-09 18:39:42,174 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/intermediate"]
2014-04-09 18:39:42,175 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0002_m_000000_0 is done. And is in the process of commiting
2014-04-09 18:39:42,176 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 18:39:42,176 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0002_m_000000_0 is allowed to commit now
2014-04-09 18:39:42,178 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0002_m_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/intermediate
2014-04-09 18:39:45,162 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt:0+19
2014-04-09 18:39:45,164 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0002_m_000000_0' done.
2014-04-09 18:39:45,179 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/intermediate/_temporary
2014-04-09 18:39:45,196 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 18:39:45,196 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 18:39:45,218 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [lhs*rhs] starting
2014-04-09 18:39:45,219 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [lhs*rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/intermediate"]
2014-04-09 18:39:45,219 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [lhs*rhs] sink: Hfs["TextLine[['line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/cogroupsplit"]
2014-04-09 18:39:45,219 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [lhs*rhs] parallel execution is enabled: false
2014-04-09 18:39:45,220 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [lhs*rhs] starting jobs: 1
2014-04-09 18:39:45,220 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [lhs*rhs] allocating threads: 1
2014-04-09 18:39:45,221 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs*rhs] starting step: (1/1) ...ipesplatform/cogroupsplit
2014-04-09 18:39:45,238 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 18:39:45,281 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs*rhs] submitted hadoop job: job_local_0003
2014-04-09 18:39:45,282 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs*rhs] tracking url: http://localhost:8080/
2014-04-09 18:39:45,284 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@556667e6
2014-04-09 18:39:45,284 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/intermediate/part-00000
2014-04-09 18:39:45,285 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 18:39:45,289 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 18:39:45,298 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 18:39:45,298 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 18:39:45,307 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 18:39:45,307 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 18:39:45,321 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/intermediate"]
2014-04-09 18:39:45,321 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: CoGroup(lhs*rhs)[by: lhs:[{1}:'num'] rhs:[{1}:'num2']]
2014-04-09 18:39:45,325 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 18:39:45,330 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 18:39:45,331 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0003_m_000000_0 is done. And is in the process of commiting
2014-04-09 18:39:48,284 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/intermediate/part-00000:0+20
2014-04-09 18:39:48,285 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0003_m_000000_0' done.
2014-04-09 18:39:48,293 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@207bfdc3
2014-04-09 18:39:48,293 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 18:39:48,297 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 18:39:48,298 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 162 bytes
2014-04-09 18:39:48,298 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 18:39:48,299 INFO hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 18:39:48,300 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 18:39:48,307 INFO hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: CoGroup(lhs*rhs)[by: lhs:[{1}:'num'] rhs:[{1}:'num2']]
2014-04-09 18:39:48,307 INFO hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextLine[['line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/cogroupsplit"]
2014-04-09 18:39:48,314 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2014-04-09 18:39:48,314 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2014-04-09 18:39:48,319 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0003_r_000000_0 is done. And is in the process of commiting
2014-04-09 18:39:48,320 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 18:39:48,320 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0003_r_000000_0 is allowed to commit now
2014-04-09 18:39:48,322 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0003_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/cogroupsplit
2014-04-09 18:39:51,293 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 18:39:51,294 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0003_r_000000_0' done.
2014-04-09 18:39:51,325 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/cogroupsplit/_temporary
2014-04-09 18:39:51,338 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 18:39:51,348 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 18:39:51,349 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/regressionpipesplatform/intermediate
2014-04-09 18:39:51,350 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/regressionpipesplatform/cogroupsplit
2014-04-09 18:39:51,359 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 18:39:51,359 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 18:39:51,373 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] starting
2014-04-09 18:39:51,373 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower+upper.txt"]
2014-04-09 18:39:51,373 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/none-unknown"]
2014-04-09 18:39:51,373 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] parallel execution is enabled: false
2014-04-09 18:39:51,373 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] starting jobs: 1
2014-04-09 18:39:51,373 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] allocating threads: 1
2014-04-09 18:39:51,374 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] starting step: (1/1) ...ipesplatform/none-unknown
2014-04-09 18:39:51,383 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 18:39:51,409 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] submitted hadoop job: job_local_0004
2014-04-09 18:39:51,409 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] tracking url: http://localhost:8080/
2014-04-09 18:39:51,411 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@52751c6f
2014-04-09 18:39:51,411 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower+upper.txt
2014-04-09 18:39:51,412 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 18:39:51,412 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 18:39:51,423 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 18:39:51,424 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 18:39:51,425 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 18:39:51,425 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 18:39:51,431 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower+upper.txt"]
2014-04-09 18:39:51,431 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(test)[by:[{?}:NONE]]
2014-04-09 18:39:51,432 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 18:39:51,434 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 18:39:51,435 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0004_m_000000_0 is done. And is in the process of commiting
2014-04-09 18:39:54,411 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower+upper.txt:0+30
2014-04-09 18:39:54,412 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0004_m_000000_0' done.
2014-04-09 18:39:54,417 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@ea29603
2014-04-09 18:39:54,417 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 18:39:54,419 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 18:39:54,419 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 147 bytes
2014-04-09 18:39:54,419 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 18:39:54,420 INFO hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 18:39:54,420 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 18:39:54,424 INFO hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(test)[by:[{?}:NONE]]
2014-04-09 18:39:54,424 INFO hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/none-unknown"]
2014-04-09 18:39:54,428 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0004_r_000000_0 is done. And is in the process of commiting
2014-04-09 18:39:54,428 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 18:39:54,429 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0004_r_000000_0 is allowed to commit now
2014-04-09 18:39:54,430 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0004_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/none-unknown
2014-04-09 18:39:57,417 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 18:39:57,418 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0004_r_000000_0' done.
2014-04-09 18:39:57,423 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/none-unknown/_temporary
2014-04-09 18:39:57,432 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 18:39:57,433 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/regressionpipesplatform/none-unknown
2014-04-09 18:39:57,439 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 18:39:57,439 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 18:39:57,451 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] starting
2014-04-09 18:39:57,452 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/apache.10.txt"]
2014-04-09 18:39:57,452 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/oomepre"]
2014-04-09 18:39:57,453 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] parallel execution is enabled: false
2014-04-09 18:39:57,453 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] starting jobs: 1
2014-04-09 18:39:57,453 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] allocating threads: 1
2014-04-09 18:39:57,453 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] starting step: (1/1) ...sionpipesplatform/oomepre
2014-04-09 18:39:57,464 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 18:39:57,482 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] submitted hadoop job: job_local_0005
2014-04-09 18:39:57,482 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] tracking url: http://localhost:8080/
2014-04-09 18:39:57,484 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@6dee8d1f
2014-04-09 18:39:57,485 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/apache.10.txt
2014-04-09 18:39:57,491 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 0
2014-04-09 18:39:57,495 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 18:39:57,495 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 18:39:57,499 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/apache.10.txt"]
2014-04-09 18:39:57,499 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/oomepre"]
2014-04-09 18:39:57,501 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught OutOfMemoryException, will not trap, rethrowing
java.lang.OutOfMemoryError: fake error
at cascading.RegressionPipesPlatformTest$1.throwIntentionalException(RegressionPipesPlatformTest.java:593)
at cascading.TestFunction.operate(TestFunction.java:74)
at cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:99)
at cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:39)
at cascading.flow.stream.SourceStage.map(SourceStage.java:102)
at cascading.flow.stream.SourceStage.run(SourceStage.java:58)
at cascading.flow.hadoop.FlowMapper.run(FlowMapper.java:127)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:436)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:212)
2014-04-09 18:39:57,502 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(298)) - job_local_0005
java.lang.OutOfMemoryError: fake error
at cascading.RegressionPipesPlatformTest$1.throwIntentionalException(RegressionPipesPlatformTest.java:593)
at cascading.TestFunction.operate(TestFunction.java:74)
at cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:99)
at cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:39)
at cascading.flow.stream.SourceStage.map(SourceStage.java:102)
at cascading.flow.stream.SourceStage.run(SourceStage.java:58)
at cascading.flow.hadoop.FlowMapper.run(FlowMapper.java:127)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:436)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:212)
2014-04-09 18:39:57,503 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [test] hadoop job job_local_0005 state at FAILED
2014-04-09 18:39:57,503 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [test] failure info: NA
2014-04-09 18:39:57,504 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [test] task completion events identify failed tasks
2014-04-09 18:39:57,504 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [test] task completion events count: 0
2014-04-09 18:39:57,505 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] stopping all jobs
2014-04-09 18:39:57,505 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] stopping: (1/1) ...sionpipesplatform/oomepre
2014-04-09 18:39:57,505 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] stopped all jobs
2014-04-09 18:39:57,506 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/oomepre/_temporary
exception = cascading.flow.FlowException: local step failed
2014-04-09 18:39:57,507 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/regressionpipesplatform/oomepre
2014-04-09 18:39:57,513 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 18:39:57,514 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 18:39:57,521 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] starting
2014-04-09 18:39:57,522 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower+upper.txt"]
2014-04-09 18:39:57,522 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/copy"]
2014-04-09 18:39:57,522 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] parallel execution is enabled: false
2014-04-09 18:39:57,522 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] starting jobs: 1
2014-04-09 18:39:57,523 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] allocating threads: 1
2014-04-09 18:39:57,523 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] starting step: (1/1) ...ressionpipesplatform/copy
2014-04-09 18:39:57,537 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 18:39:57,551 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] submitted hadoop job: job_local_0006
2014-04-09 18:39:57,552 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] tracking url: http://localhost:8080/
2014-04-09 18:39:57,555 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@6500cd32
2014-04-09 18:39:57,557 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower+upper.txt
2014-04-09 18:39:57,558 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 0
2014-04-09 18:39:57,560 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 18:39:57,560 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 18:39:57,563 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower+upper.txt"]
2014-04-09 18:39:57,563 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/copy"]
2014-04-09 18:39:57,564 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0006_m_000000_0 is done. And is in the process of commiting
2014-04-09 18:39:57,564 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 18:39:57,564 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0006_m_000000_0 is allowed to commit now
2014-04-09 18:39:57,566 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0006_m_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/copy
2014-04-09 18:40:00,555 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower+upper.txt:0+30
2014-04-09 18:40:00,556 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0006_m_000000_0' done.
2014-04-09 18:40:00,560 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/copy/_temporary
2014-04-09 18:40:00,570 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 18:40:00,571 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/regressionpipesplatform/copy
2014-04-09 18:40:00,578 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 18:40:00,579 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 18:40:00,590 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] starting
2014-04-09 18:40:00,590 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] source: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower+upper.txt"]
2014-04-09 18:40:00,591 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] sink: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/unknown-replace"]
2014-04-09 18:40:00,591 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] parallel execution is enabled: false
2014-04-09 18:40:00,591 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] starting jobs: 1
2014-04-09 18:40:00,591 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] allocating threads: 1
2014-04-09 18:40:00,592 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] starting step: (1/1) ...splatform/unknown-replace
2014-04-09 18:40:00,598 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 18:40:00,611 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] submitted hadoop job: job_local_0007
2014-04-09 18:40:00,612 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] tracking url: http://localhost:8080/
2014-04-09 18:40:00,613 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@766bca5f
2014-04-09 18:40:00,614 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower+upper.txt
2014-04-09 18:40:00,615 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 0
2014-04-09 18:40:00,616 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 18:40:00,616 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 18:40:00,621 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower+upper.txt"]
2014-04-09 18:40:00,621 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/unknown-replace"]
2014-04-09 18:40:00,622 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0007_m_000000_0 is done. And is in the process of commiting
2014-04-09 18:40:00,622 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 18:40:00,623 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0007_m_000000_0 is allowed to commit now
2014-04-09 18:40:00,624 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0007_m_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/unknown-replace
2014-04-09 18:40:03,485 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/apache.10.txt:0+1449
2014-04-09 18:40:03,613 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower+upper.txt:0+30
2014-04-09 18:40:03,614 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0007_m_000000_0' done.
2014-04-09 18:40:03,620 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/unknown-replace/_temporary
2014-04-09 18:40:03,630 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 18:40:03,635 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 18:40:03,635 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/regressionpipesplatform/unknown-replace
2014-04-09 18:40:03,641 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 18:40:03,642 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 18:40:03,652 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] starting
2014-04-09 18:40:03,653 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 18:40:03,653 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] sink: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/regression/complexlogicand"]
2014-04-09 18:40:03,654 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] parallel execution is enabled: false
2014-04-09 18:40:03,654 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] starting jobs: 1
2014-04-09 18:40:03,654 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] allocating threads: 1
2014-04-09 18:40:03,655 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] starting step: (1/1) ...egression/complexlogicand
2014-04-09 18:40:03,662 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 18:40:03,674 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] submitted hadoop job: job_local_0008
2014-04-09 18:40:03,675 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] tracking url: http://localhost:8080/
2014-04-09 18:40:03,678 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@512566c9
2014-04-09 18:40:03,679 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 18:40:03,680 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 0
2014-04-09 18:40:03,681 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 18:40:03,681 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 18:40:03,686 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 18:40:03,686 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/regression/complexlogicand"]
2014-04-09 18:40:03,687 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0008_m_000000_0 is done. And is in the process of commiting
2014-04-09 18:40:03,688 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 18:40:03,688 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0008_m_000000_0 is allowed to commit now
2014-04-09 18:40:03,689 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0008_m_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/regression/complexlogicand
2014-04-09 18:40:06,678 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 18:40:06,679 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0008_m_000000_0' done.
2014-04-09 18:40:06,693 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/regression/complexlogicand/_temporary
2014-04-09 18:40:06,701 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 18:40:06,702 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/regressionpipesplatform/regression/complexlogicand
2014-04-09 18:40:06,708 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 18:40:06,708 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 18:40:06,718 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] starting
2014-04-09 18:40:06,719 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 18:40:06,719 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] sink: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/regression/complexlogicxor"]
2014-04-09 18:40:06,720 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] parallel execution is enabled: false
2014-04-09 18:40:06,720 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] starting jobs: 1
2014-04-09 18:40:06,720 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] allocating threads: 1
2014-04-09 18:40:06,721 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] starting step: (1/1) ...egression/complexlogicxor
2014-04-09 18:40:06,732 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 18:40:06,748 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] submitted hadoop job: job_local_0009
2014-04-09 18:40:06,748 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] tracking url: http://localhost:8080/
2014-04-09 18:40:06,749 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@338cd072
2014-04-09 18:40:06,750 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 18:40:06,751 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 0
2014-04-09 18:40:06,753 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 18:40:06,753 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 18:40:06,757 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 18:40:06,758 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/regression/complexlogicxor"]
2014-04-09 18:40:06,759 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0009_m_000000_0 is done. And is in the process of commiting
2014-04-09 18:40:06,759 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 18:40:06,760 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0009_m_000000_0 is allowed to commit now
2014-04-09 18:40:06,761 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0009_m_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/regression/complexlogicxor
2014-04-09 18:40:09,750 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 18:40:09,751 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0009_m_000000_0' done.
2014-04-09 18:40:09,756 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/regression/complexlogicxor/_temporary
2014-04-09 18:40:09,762 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 18:40:09,763 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/regressionpipesplatform/regression/complexlogicxor
2014-04-09 18:40:09,768 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 18:40:09,768 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 18:40:09,784 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [lower*upper] starting
2014-04-09 18:40:09,784 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/upper.txt"]
2014-04-09 18:40:09,784 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt"]
2014-04-09 18:40:09,785 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [lower*upper] sink: Hfs["TextLine[['line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/oomepost"]
2014-04-09 18:40:09,785 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [lower*upper] parallel execution is enabled: false
2014-04-09 18:40:09,785 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [lower*upper] starting jobs: 1
2014-04-09 18:40:09,785 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [lower*upper] allocating threads: 1
2014-04-09 18:40:09,785 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/1) ...ionpipesplatform/oomepost
2014-04-09 18:40:09,791 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 18:40:09,791 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 18:40:09,808 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_local_0010
2014-04-09 18:40:09,809 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://localhost:8080/
2014-04-09 18:40:09,810 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@7ba6b660
2014-04-09 18:40:09,811 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt
2014-04-09 18:40:09,812 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 18:40:09,812 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 18:40:09,823 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 18:40:09,823 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 18:40:09,824 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 18:40:09,824 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 18:40:09,830 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt"]
2014-04-09 18:40:09,830 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: CoGroup(lower*upper)[by: lower:[{1}:'num'] upper:[{1}:'num']]
2014-04-09 18:40:09,831 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 18:40:09,832 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 18:40:09,833 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0010_m_000000_0 is done. And is in the process of commiting
2014-04-09 18:40:12,811 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt:0+19
2014-04-09 18:40:12,812 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0010_m_000000_0' done.
2014-04-09 18:40:12,814 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@5b1e31c0
2014-04-09 18:40:12,816 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/upper.txt
2014-04-09 18:40:12,817 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 18:40:12,817 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 18:40:12,827 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 18:40:12,827 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 18:40:12,828 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 18:40:12,828 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 18:40:12,833 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/upper.txt"]
2014-04-09 18:40:12,833 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: CoGroup(lower*upper)[by: lower:[{1}:'num'] upper:[{1}:'num']]
2014-04-09 18:40:12,834 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 18:40:12,835 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 18:40:12,836 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0010_m_000001_0 is done. And is in the process of commiting
2014-04-09 18:40:15,814 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/upper.txt:0+19
2014-04-09 18:40:15,815 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0010_m_000001_0' done.
2014-04-09 18:40:15,822 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@6c2d0dd2
2014-04-09 18:40:15,822 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 18:40:15,824 INFO mapred.Merger (Merger.java:merge(390)) - Merging 2 sorted segments
2014-04-09 18:40:15,825 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 2 segments left of total size: 194 bytes
2014-04-09 18:40:15,825 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 18:40:15,826 INFO hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 18:40:15,826 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 18:40:15,832 INFO hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: CoGroup(lower*upper)[by: lower:[{1}:'num'] upper:[{1}:'num']]
2014-04-09 18:40:15,832 INFO hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextLine[['line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/oomepost"]
2014-04-09 18:40:15,834 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2014-04-09 18:40:15,834 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2014-04-09 18:40:15,834 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught OutOfMemoryException, will not trap, rethrowing
java.lang.OutOfMemoryError: fake error
at cascading.RegressionPipesPlatformTest$2.throwIntentionalException(RegressionPipesPlatformTest.java:643)
at cascading.TestFunction.operate(TestFunction.java:74)
at cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:99)
at cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:39)
at cascading.flow.stream.OpenDuct.receive(OpenDuct.java:45)
at cascading.flow.stream.OpenDuct.receive(OpenDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:133)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:519)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:420)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:260)
2014-04-09 18:40:15,835 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(298)) - job_local_0010
java.lang.OutOfMemoryError: fake error
at cascading.RegressionPipesPlatformTest$2.throwIntentionalException(RegressionPipesPlatformTest.java:643)
at cascading.TestFunction.operate(TestFunction.java:74)
at cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:99)
at cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:39)
at cascading.flow.stream.OpenDuct.receive(OpenDuct.java:45)
at cascading.flow.stream.OpenDuct.receive(OpenDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:133)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:519)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:420)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:260)
2014-04-09 18:40:15,843 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [lower*upper] hadoop job job_local_0010 state at FAILED
2014-04-09 18:40:15,843 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [lower*upper] failure info: NA
2014-04-09 18:40:15,843 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [lower*upper] task completion events identify failed tasks
2014-04-09 18:40:15,843 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [lower*upper] task completion events count: 0
2014-04-09 18:40:15,844 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [lower*upper] stopping all jobs
2014-04-09 18:40:15,844 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] stopping: (1/1) ...ionpipesplatform/oomepost
2014-04-09 18:40:15,845 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [lower*upper] stopped all jobs
2014-04-09 18:40:15,845 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/oomepost/_temporary
exception = cascading.flow.FlowException: local step failed
2014-04-09 18:40:15,846 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/regressionpipesplatform/oomepost
2014-04-09 18:40:15,857 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 18:40:15,858 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 18:40:15,867 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] starting
2014-04-09 18:40:15,867 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/apache.10.txt"]
2014-04-09 18:40:15,868 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/lasteachmodified"]
2014-04-09 18:40:15,868 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] parallel execution is enabled: false
2014-04-09 18:40:15,868 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] starting jobs: 1
2014-04-09 18:40:15,868 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] allocating threads: 1
2014-04-09 18:40:15,869 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] starting step: (1/1) ...platform/lasteachmodified
2014-04-09 18:40:15,874 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 18:40:15,885 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] submitted hadoop job: job_local_0011
2014-04-09 18:40:15,886 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] tracking url: http://localhost:8080/
2014-04-09 18:40:15,888 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@75780a91
2014-04-09 18:40:15,889 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/apache.10.txt
2014-04-09 18:40:15,890 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 18:40:15,890 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 18:40:15,899 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 18:40:15,899 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 18:40:15,900 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 18:40:15,900 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 18:40:15,904 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/apache.10.txt"]
2014-04-09 18:40:15,904 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(test)[by:[{1}:'insert']]
2014-04-09 18:40:15,905 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 18:40:15,907 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 18:40:15,907 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0011_m_000000_0 is done. And is in the process of commiting
2014-04-09 18:40:18,889 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/apache.10.txt:0+1449
2014-04-09 18:40:18,890 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0011_m_000000_0' done.
2014-04-09 18:40:18,894 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@786aa66a
2014-04-09 18:40:18,894 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 18:40:18,896 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 18:40:18,896 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 182 bytes
2014-04-09 18:40:18,897 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 18:40:18,898 INFO hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 18:40:18,898 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 18:40:18,902 INFO hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(test)[by:[{1}:'insert']]
2014-04-09 18:40:18,902 INFO hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/lasteachmodified"]
2014-04-09 18:40:18,905 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0011_r_000000_0 is done. And is in the process of commiting
2014-04-09 18:40:18,905 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 18:40:18,905 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0011_r_000000_0 is allowed to commit now
2014-04-09 18:40:18,907 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0011_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/lasteachmodified
2014-04-09 18:40:21,823 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 18:40:21,894 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 18:40:21,895 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0011_r_000000_0' done.
2014-04-09 18:40:21,900 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/lasteachmodified/_temporary
2014-04-09 18:40:21,911 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 18:40:21,913 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/regressionpipesplatform/lasteachmodified
2014-04-09 18:40:21,921 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 18:40:21,921 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 18:40:21,931 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] starting
2014-04-09 18:40:21,931 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower+upper.txt"]
2014-04-09 18:40:21,932 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/unknown"]
2014-04-09 18:40:21,932 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] parallel execution is enabled: false
2014-04-09 18:40:21,932 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] starting jobs: 1
2014-04-09 18:40:21,933 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] allocating threads: 1
2014-04-09 18:40:21,933 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] starting step: (1/1) ...sionpipesplatform/unknown
2014-04-09 18:40:21,941 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 18:40:21,952 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] submitted hadoop job: job_local_0012
2014-04-09 18:40:21,952 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] tracking url: http://localhost:8080/
2014-04-09 18:40:21,955 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@e8c744d
2014-04-09 18:40:21,956 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower+upper.txt
2014-04-09 18:40:21,957 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 0
2014-04-09 18:40:21,959 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 18:40:21,959 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 18:40:21,963 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower+upper.txt"]
2014-04-09 18:40:21,964 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/unknown"]
2014-04-09 18:40:21,964 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0012_m_000000_0 is done. And is in the process of commiting
2014-04-09 18:40:21,965 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 18:40:21,965 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0012_m_000000_0 is allowed to commit now
2014-04-09 18:40:21,966 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0012_m_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/unknown
2014-04-09 18:40:24,955 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower+upper.txt:0+30
2014-04-09 18:40:24,956 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0012_m_000000_0' done.
2014-04-09 18:40:24,960 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/unknown/_temporary
2014-04-09 18:40:24,969 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 18:40:24,969 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/regressionpipesplatform/unknown
2014-04-09 18:40:24,975 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 18:40:24,975 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 18:40:24,984 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] starting
2014-04-09 18:40:24,985 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/critics.txt"]
2014-04-09 18:40:24,985 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/varwidth"]
2014-04-09 18:40:24,985 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] parallel execution is enabled: false
2014-04-09 18:40:24,985 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] starting jobs: 1
2014-04-09 18:40:24,985 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] allocating threads: 1
2014-04-09 18:40:24,985 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] starting step: (1/1) ...ionpipesplatform/varwidth
2014-04-09 18:40:24,989 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 18:40:25,000 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] submitted hadoop job: job_local_0013
2014-04-09 18:40:25,000 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] tracking url: http://localhost:8080/
2014-04-09 18:40:25,001 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@44939462
2014-04-09 18:40:25,002 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/critics.txt
2014-04-09 18:40:25,002 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 0
2014-04-09 18:40:25,004 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 18:40:25,004 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 18:40:25,009 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/critics.txt"]
2014-04-09 18:40:25,010 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/varwidth"]
2014-04-09 18:40:25,011 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0013_m_000000_0 is done. And is in the process of commiting
2014-04-09 18:40:25,011 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 18:40:25,012 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0013_m_000000_0 is allowed to commit now
2014-04-09 18:40:25,013 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0013_m_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/varwidth
2014-04-09 18:40:28,001 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/critics.txt:0+828
2014-04-09 18:40:28,002 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0013_m_000000_0' done.
2014-04-09 18:40:28,008 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/varwidth/_temporary
2014-04-09 18:40:28,017 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 18:40:28,019 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/regressionpipesplatform/varwidth
2014-04-09 18:40:28,163 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 18:40:28,163 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 18:40:28,472 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipeline] starting
2014-04-09 18:40:28,472 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipeline] source: Hfs["TextLine[['line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/apache.200.txt"]
2014-04-09 18:40:28,472 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipeline] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/deeppipline"]
2014-04-09 18:40:28,473 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipeline] parallel execution is enabled: false
2014-04-09 18:40:28,473 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipeline] starting jobs: 1
2014-04-09 18:40:28,473 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipeline] allocating threads: 1
2014-04-09 18:40:28,473 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipeline] starting step: (1/1) ...pipesplatform/deeppipline
2014-04-09 18:40:28,477 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 18:40:28,489 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipeline] submitted hadoop job: job_local_0014
2014-04-09 18:40:28,489 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipeline] tracking url: http://localhost:8080/
2014-04-09 18:40:28,492 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@2dee1281
2014-04-09 18:40:28,494 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/apache.200.txt
2014-04-09 18:40:28,495 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 18:40:28,496 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 18:40:28,577 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 18:40:28,577 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 18:40:28,578 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 18:40:28,578 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 18:40:28,681 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/apache.200.txt"]
2014-04-09 18:40:28,681 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(pipeline)[by:[{1}:'hash']]
2014-04-09 18:40:28,806 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 18:40:28,817 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 18:40:28,818 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0014_m_000000_0 is done. And is in the process of commiting
2014-04-09 18:40:31,492 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/apache.200.txt:0+32599
2014-04-09 18:40:31,493 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0014_m_000000_0' done.
2014-04-09 18:40:31,497 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@54d0e307
2014-04-09 18:40:31,497 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 18:40:31,498 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 18:40:31,498 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 35984 bytes
2014-04-09 18:40:31,498 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 18:40:31,499 INFO hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 18:40:31,499 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 18:40:31,557 INFO hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(pipeline)[by:[{1}:'hash']]
2014-04-09 18:40:31,557 INFO hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/deeppipline"]
2014-04-09 18:40:31,766 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0014_r_000000_0 is done. And is in the process of commiting
2014-04-09 18:40:31,766 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 18:40:31,766 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0014_r_000000_0 is allowed to commit now
2014-04-09 18:40:31,768 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0014_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/deeppipline
2014-04-09 18:40:34,496 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 18:40:34,497 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0014_r_000000_0' done.
2014-04-09 18:40:34,509 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/deeppipline/_temporary
2014-04-09 18:40:34,509 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/regressionpipesplatform/deeppipline
2014-04-09 18:40:34,519 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 18:40:34,520 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 18:40:34,525 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [split] starting
2014-04-09 18:40:34,525 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [split] source: Hfs["TextLine[['line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt"]
2014-04-09 18:40:34,525 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [split] sink: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/splitintermediate"]
2014-04-09 18:40:34,525 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [split] parallel execution is enabled: false
2014-04-09 18:40:34,525 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [split] starting jobs: 1
2014-04-09 18:40:34,525 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [split] allocating threads: 1
2014-04-09 18:40:34,525 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [split] starting step: (1/1) ...latform/splitintermediate
2014-04-09 18:40:34,529 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 18:40:34,539 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [split] submitted hadoop job: job_local_0015
2014-04-09 18:40:34,539 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [split] tracking url: http://localhost:8080/
2014-04-09 18:40:34,541 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@7858e204
2014-04-09 18:40:34,542 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt
2014-04-09 18:40:34,542 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 0
2014-04-09 18:40:34,544 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 18:40:34,544 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 18:40:34,546 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextLine[['line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt"]
2014-04-09 18:40:34,546 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/splitintermediate"]
2014-04-09 18:40:34,547 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0015_m_000000_0 is done. And is in the process of commiting
2014-04-09 18:40:34,547 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 18:40:34,548 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0015_m_000000_0 is allowed to commit now
2014-04-09 18:40:34,549 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0015_m_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/splitintermediate
2014-04-09 18:40:37,541 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt:0+19
2014-04-09 18:40:37,542 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0015_m_000000_0' done.
2014-04-09 18:40:37,547 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/splitintermediate/_temporary
2014-04-09 18:40:37,552 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 18:40:37,552 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 18:40:37,559 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [lhs+rhs] starting
2014-04-09 18:40:37,559 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [lhs+rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/splitintermediate"]
2014-04-09 18:40:37,559 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [lhs+rhs] sink: Hfs["TextLine[['line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/groupbysplit"]
2014-04-09 18:40:37,560 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [lhs+rhs] parallel execution is enabled: false
2014-04-09 18:40:37,560 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [lhs+rhs] starting jobs: 1
2014-04-09 18:40:37,560 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [lhs+rhs] allocating threads: 1
2014-04-09 18:40:37,560 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs+rhs] starting step: (1/1) ...ipesplatform/groupbysplit
2014-04-09 18:40:37,568 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 18:40:37,582 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs+rhs] submitted hadoop job: job_local_0016
2014-04-09 18:40:37,582 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs+rhs] tracking url: http://localhost:8080/
2014-04-09 18:40:37,585 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@528c4c14
2014-04-09 18:40:37,586 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/splitintermediate/part-00000
2014-04-09 18:40:37,587 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 18:40:37,588 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 18:40:37,598 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 18:40:37,599 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 18:40:37,599 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 18:40:37,599 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 18:40:37,602 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/splitintermediate"]
2014-04-09 18:40:37,602 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(lhs+rhs)[by: lhs:[{1}:'num'] rhs:[{1}:'num']]
2014-04-09 18:40:37,603 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 18:40:37,604 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 18:40:37,605 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0016_m_000000_0 is done. And is in the process of commiting
2014-04-09 18:40:40,585 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/splitintermediate/part-00000:0+20
2014-04-09 18:40:40,586 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0016_m_000000_0' done.
2014-04-09 18:40:40,589 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@7ef4cf7f
2014-04-09 18:40:40,589 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 18:40:40,589 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 18:40:40,590 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 172 bytes
2014-04-09 18:40:40,590 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 18:40:40,590 INFO hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 18:40:40,590 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 18:40:40,592 INFO hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(lhs+rhs)[by: lhs:[{1}:'num'] rhs:[{1}:'num']]
2014-04-09 18:40:40,593 INFO hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextLine[['line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/groupbysplit"]
2014-04-09 18:40:40,595 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0016_r_000000_0 is done. And is in the process of commiting
2014-04-09 18:40:40,595 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 18:40:40,595 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0016_r_000000_0 is allowed to commit now
2014-04-09 18:40:40,596 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0016_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/groupbysplit
2014-04-09 18:40:43,589 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 18:40:43,590 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0016_r_000000_0' done.
2014-04-09 18:40:43,597 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/groupbysplit/_temporary
2014-04-09 18:40:43,606 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 18:40:43,612 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 18:40:43,613 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/regressionpipesplatform/groupbysplit
2014-04-09 18:40:43,613 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/regressionpipesplatform/splitintermediate
2014-04-09 18:40:43,617 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 18:40:43,618 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 18:40:43,629 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [**&%&%bar:bar@foo://bl...] starting
2014-04-09 18:40:43,629 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [**&%&%bar:bar@foo://bl...] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower+upper.txt"]
2014-04-09 18:40:43,630 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [**&%&%bar:bar@foo://bl...] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/illegalchars"]
2014-04-09 18:40:43,630 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [**&%&%bar:bar@foo://bl...] parallel execution is enabled: false
2014-04-09 18:40:43,630 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [**&%&%bar:bar@foo://bl...] starting jobs: 2
2014-04-09 18:40:43,630 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [**&%&%bar:bar@foo://bl...] allocating threads: 1
2014-04-09 18:40:43,630 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [**&%&%bar:bar@foo://bl...] starting step: (1/2)
2014-04-09 18:40:43,635 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 18:40:43,645 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [**&%&%bar:bar@foo://bl...] submitted hadoop job: job_local_0017
2014-04-09 18:40:43,645 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [**&%&%bar:bar@foo://bl...] tracking url: http://localhost:8080/
2014-04-09 18:40:43,647 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@1c7d030d
2014-04-09 18:40:43,648 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower+upper.txt
2014-04-09 18:40:43,649 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 18:40:43,649 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 18:40:43,659 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 18:40:43,659 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 18:40:43,660 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 18:40:43,660 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 18:40:43,662 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower+upper.txt"]
2014-04-09 18:40:43,662 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(**&%&%bar:bar@foo://blah/ (*(**^**&%&%^@#@&&() :::: ///\\ illegal chars in it)[by:[{1}:0]]
2014-04-09 18:40:43,663 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 18:40:43,664 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 18:40:43,664 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0017_m_000000_0 is done. And is in the process of commiting
2014-04-09 18:40:46,647 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower+upper.txt:0+30
2014-04-09 18:40:46,648 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0017_m_000000_0' done.
2014-04-09 18:40:46,650 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@2317a576
2014-04-09 18:40:46,650 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 18:40:46,650 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 18:40:46,651 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 77 bytes
2014-04-09 18:40:46,651 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 18:40:46,651 INFO hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 18:40:46,651 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 18:40:46,653 INFO hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(**&%&%bar:bar@foo://blah/ (*(**^**&%&%^@#@&&() :::: ///\\ illegal chars in it)[by:[{1}:0]]
2014-04-09 18:40:46,653 INFO hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: TempHfs["SequenceFile[[UNKNOWN]->[ALL]]"][358463009/__&%&%bar:bar@foo:_blah_/]
2014-04-09 18:40:46,659 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0017_r_000000_0 is done. And is in the process of commiting
2014-04-09 18:40:46,659 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 18:40:46,659 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0017_r_000000_0 is allowed to commit now
2014-04-09 18:40:46,660 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0017_r_000000_0' to file:/tmp/hadoop-brock/358463009____bar_bar_foo__blah__C5F50B33B012444FB700F9DE422D9E13
2014-04-09 18:40:49,650 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 18:40:49,651 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0017_r_000000_0' done.
2014-04-09 18:40:49,660 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [**&%&%bar:bar@foo://bl...] starting step: (2/2) ...ipesplatform/illegalchars
2014-04-09 18:40:49,665 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 18:40:49,675 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [**&%&%bar:bar@foo://bl...] submitted hadoop job: job_local_0018
2014-04-09 18:40:49,675 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [**&%&%bar:bar@foo://bl...] tracking url: http://localhost:8080/
2014-04-09 18:40:49,676 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@5139bf8d
2014-04-09 18:40:49,677 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-brock/358463009____bar_bar_foo__blah__C5F50B33B012444FB700F9DE422D9E13/part-00000
2014-04-09 18:40:49,680 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 18:40:49,680 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 18:40:49,691 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 18:40:49,691 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 18:40:49,692 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 18:40:49,692 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 18:40:49,694 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: TempHfs["SequenceFile[[UNKNOWN]->[ALL]]"][358463009/__&%&%bar:bar@foo:_blah_/]
2014-04-09 18:40:49,694 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(**&%&%bar:bar@foo://blah/ (*(**^**&%&%^@#@&&() :::: ///\\ illegal chars in it)[by:[{1}:0]]
2014-04-09 18:40:49,695 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 18:40:49,696 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 18:40:49,696 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0018_m_000000_0 is done. And is in the process of commiting
2014-04-09 18:40:52,676 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/tmp/hadoop-brock/358463009____bar_bar_foo__blah__C5F50B33B012444FB700F9DE422D9E13/part-00000:0+170
2014-04-09 18:40:52,677 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0018_m_000000_0' done.
2014-04-09 18:40:52,679 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@3ec7f77e
2014-04-09 18:40:52,679 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 18:40:52,680 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 18:40:52,680 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 77 bytes
2014-04-09 18:40:52,680 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 18:40:52,680 INFO hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 18:40:52,681 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 18:40:52,683 INFO hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(**&%&%bar:bar@foo://blah/ (*(**^**&%&%^@#@&&() :::: ///\\ illegal chars in it)[by:[{1}:0]]
2014-04-09 18:40:52,683 INFO hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/illegalchars"]
2014-04-09 18:40:52,684 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0018_r_000000_0 is done. And is in the process of commiting
2014-04-09 18:40:52,685 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 18:40:52,685 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0018_r_000000_0 is allowed to commit now
2014-04-09 18:40:52,686 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0018_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/illegalchars
2014-04-09 18:40:55,679 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 18:40:55,680 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0018_r_000000_0' done.
2014-04-09 18:40:55,690 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/illegalchars/_temporary
2014-04-09 18:40:55,698 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 18:40:55,699 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/regressionpipesplatform/illegalchars
2014-04-09 18:40:55,704 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 18:40:55,704 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 18:40:55,709 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] starting
2014-04-09 18:40:55,709 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower+upper.txt"]
2014-04-09 18:40:55,709 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/ungrouped-unknown-nondeterministic"]
2014-04-09 18:40:55,710 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] parallel execution is enabled: false
2014-04-09 18:40:55,710 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] starting jobs: 1
2014-04-09 18:40:55,710 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [test] allocating threads: 1
2014-04-09 18:40:55,711 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] starting step: (1/1) ...-unknown-nondeterministic
2014-04-09 18:40:55,718 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 18:40:55,726 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] submitted hadoop job: job_local_0019
2014-04-09 18:40:55,726 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] tracking url: http://localhost:8080/
2014-04-09 18:40:55,728 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@5f701cd1
2014-04-09 18:40:55,729 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower+upper.txt
2014-04-09 18:40:55,730 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 0
2014-04-09 18:40:55,732 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 18:40:55,733 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 18:40:55,737 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower+upper.txt"]
2014-04-09 18:40:55,738 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/ungrouped-unknown-nondeterministic"]
2014-04-09 18:40:55,739 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0019_m_000000_0 is done. And is in the process of commiting
2014-04-09 18:40:55,739 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 18:40:55,739 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0019_m_000000_0 is allowed to commit now
2014-04-09 18:40:55,740 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0019_m_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/ungrouped-unknown-nondeterministic
2014-04-09 18:40:58,728 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower+upper.txt:0+30
2014-04-09 18:40:58,729 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0019_m_000000_0' done.
2014-04-09 18:40:58,734 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/regressionpipesplatform/ungrouped-unknown-nondeterministic/_temporary
2014-04-09 18:40:58,742 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 18:40:58,744 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/regressionpipesplatform/ungrouped-unknown-nondeterministic