Class cascading.pipe.assembly.AssemblyHelpersPlatformTest

30

tests

0

failures

0

ignored

3m41.80s

duration

100%

successful

Tests

Test Duration Result
testAverageBy 6.054s passed
testAverageByNull 6.057s passed
testAverageMerge 9.138s passed
testCoerce 3.041s passed
testCoerceFields 3.059s passed
testCount 6.075s passed
testCountAll 6.046s passed
testCountCount 12.138s passed
testCountMerge 9.089s passed
testCountNullNotNull 6.052s passed
testDiscardNarrow 3.045s passed
testFirstBy 6.066s passed
testMaxBy 6.060s passed
testMaxByString 6.085s passed
testMinBy 6.058s passed
testMinByString 6.152s passed
testParallelAggregates 6.054s passed
testParallelAggregatesMerge 9.637s passed
testParallelAggregatesPriorMerge 9.077s passed
testRenameAll 3.067s passed
testRenameNamed 3.040s passed
testRenameNarrow 3.046s passed
testRetainNarrow 3.037s passed
testSameSourceMerge 12.110s passed
testSameSourceMergeThreeWay 36.203s passed
testSumBy 6.064s passed
testSumByNulls 6.064s passed
testSumMerge 9.069s passed
testUnique 6.058s passed
testUniqueMerge 9.056s passed

Standard output

2014-04-09 19:31:49,281 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(187)) - found 1 test platforms from classpath
2014-04-09 19:31:49,299 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(237)) - installing platform: hadoop
2014-04-09 19:31:49,299 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(238)) - running test: cascading.pipe.assembly.AssemblyHelpersPlatformTest
2014-04-09 19:31:49,314 INFO  hadoop.HadoopPlatform (HadoopPlatform.java:setUp(112)) - not using cluster
2014-04-09 19:31:49,592 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:31:49,592 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:31:49,598 INFO  property.AppProps (AppProps.java:getAppID(162)) - using app.id: E32D0AD0514F47E597A04C119B6EE0E1
2014-04-09 19:31:49,719 INFO  util.Version (Version.java:printBanner(78)) - Concurrent, Inc - Cascading 2.5.3
2014-04-09 19:31:49,721 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [name] starting
2014-04-09 19:31:49,721 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [name]  source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt"]
2014-04-09 19:31:49,721 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [name]  source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:31:49,722 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [name]  sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/multimerge+false"]
2014-04-09 19:31:49,722 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [name]  parallel execution is enabled: false
2014-04-09 19:31:49,722 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [name]  starting jobs: 1
2014-04-09 19:31:49,722 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [name]  allocating threads: 1
2014-04-09 19:31:49,723 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [name] starting step: (1/1) ...platform/multimerge+false
2014-04-09 19:31:49,744 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(52)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2014-04-09 19:31:49,764 WARN  snappy.LoadSnappy (LoadSnappy.java:<clinit>(46)) - Snappy native library not loaded
2014-04-09 19:31:49,766 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:31:49,770 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:31:49,861 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [name] submitted hadoop job: job_local_0001
2014-04-09 19:31:49,862 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [name] tracking url: http://localhost:8080/
2014-04-09 19:31:49,889 INFO  util.ProcessTree (ProcessTree.java:isSetsidSupported(63)) - setsid exited with exit code 0
2014-04-09 19:31:49,891 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@29ab993
2014-04-09 19:31:49,894 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:31:49,897 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:31:49,900 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:31:49,909 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:31:49,910 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:31:49,919 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:31:49,919 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:31:49,949 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:31:49,950 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2014-04-09 19:31:49,951 INFO  assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:31:49,956 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:31:49,956 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 283, total: 480, max: 672
2014-04-09 19:31:49,956 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:31:49,957 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:31:49,957 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 283, total: 480, max: 672
2014-04-09 19:31:49,957 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:31:49,958 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 5, with threshold: 2
2014-04-09 19:31:49,958 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 283, total: 480, max: 672
2014-04-09 19:31:49,958 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:31:49,958 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 7, with threshold: 2
2014-04-09 19:31:49,959 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 283, total: 480, max: 672
2014-04-09 19:31:49,959 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:31:49,959 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:31:49,964 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:31:49,967 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0001_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:31:52,884 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:31:52,885 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0001_m_000000_0' done.
2014-04-09 19:31:52,888 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@13c03044
2014-04-09 19:31:52,889 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt
2014-04-09 19:31:52,889 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:31:52,890 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:31:52,899 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:31:52,899 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:31:52,900 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:31:52,900 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:31:52,913 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt"]
2014-04-09 19:31:52,913 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2014-04-09 19:31:52,914 INFO  assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:31:52,964 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:31:52,964 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 178, total: 480, max: 672
2014-04-09 19:31:52,964 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:31:52,965 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:31:52,965 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 178, total: 480, max: 672
2014-04-09 19:31:52,965 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:31:52,966 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 5, with threshold: 2
2014-04-09 19:31:52,966 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 178, total: 480, max: 672
2014-04-09 19:31:52,966 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:31:52,967 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 7, with threshold: 2
2014-04-09 19:31:52,967 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 178, total: 480, max: 672
2014-04-09 19:31:52,967 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:31:52,968 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:31:52,969 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:31:52,970 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0001_m_000001_0 is done. And is in the process of commiting
2014-04-09 19:31:55,888 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt:0+51
2014-04-09 19:31:55,889 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0001_m_000001_0' done.
2014-04-09 19:31:55,900 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@2366618
2014-04-09 19:31:55,900 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:31:55,903 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 2 sorted segments
2014-04-09 19:31:55,905 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 2 segments left of total size: 472 bytes
2014-04-09 19:31:55,905 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:31:55,905 INFO  hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:31:55,906 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:31:55,918 INFO  hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2014-04-09 19:31:55,918 INFO  hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/multimerge+false"]
2014-04-09 19:31:55,928 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0001_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:31:55,929 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:31:55,929 INFO  mapred.Task (Task.java:commit(1000)) - Task attempt_local_0001_r_000000_0 is allowed to commit now
2014-04-09 19:31:55,931 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0001_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/multimerge+false
2014-04-09 19:31:58,900 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:31:58,902 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0001_r_000000_0' done.
2014-04-09 19:31:58,915 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/multimerge+false/_temporary
2014-04-09 19:31:58,936 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:31:58,948 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:31:58,950 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/multimerge+false
2014-04-09 19:31:58,965 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:31:58,965 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:31:58,982 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [max] starting
2014-04-09 19:31:58,983 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [max]  source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:31:58,983 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [max]  sink: Hfs["TextDelimited[['num', 'min']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/minbystring"]
2014-04-09 19:31:58,983 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [max]  parallel execution is enabled: false
2014-04-09 19:31:58,983 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [max]  starting jobs: 1
2014-04-09 19:31:58,983 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [max]  allocating threads: 1
2014-04-09 19:31:58,995 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [max] starting step: (1/1) ...lpersplatform/minbystring
2014-04-09 19:31:59,004 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:31:59,059 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [max] submitted hadoop job: job_local_0002
2014-04-09 19:31:59,059 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [max] tracking url: http://localhost:8080/
2014-04-09 19:31:59,061 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@45d68783
2014-04-09 19:31:59,062 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:31:59,063 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:31:59,064 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:31:59,075 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:31:59,075 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:31:59,076 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:31:59,076 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:31:59,082 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:31:59,082 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(max)[by:[{1}:'num']]
2014-04-09 19:31:59,083 INFO  assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:31:59,084 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:31:59,084 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 164, total: 480, max: 672
2014-04-09 19:31:59,084 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:31:59,084 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:31:59,084 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 164, total: 480, max: 672
2014-04-09 19:31:59,085 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:31:59,085 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:31:59,086 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:31:59,088 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0002_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:32:02,062 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:32:02,063 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0002_m_000000_0' done.
2014-04-09 19:32:02,068 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@38bb633e
2014-04-09 19:32:02,068 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:32:02,069 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 19:32:02,069 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 87 bytes
2014-04-09 19:32:02,069 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:32:02,070 INFO  hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:32:02,070 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:32:02,076 INFO  hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(max)[by:[{1}:'num']]
2014-04-09 19:32:02,077 INFO  hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextDelimited[['num', 'min']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/minbystring"]
2014-04-09 19:32:02,080 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0002_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:32:02,081 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:32:02,081 INFO  mapred.Task (Task.java:commit(1000)) - Task attempt_local_0002_r_000000_0 is allowed to commit now
2014-04-09 19:32:02,083 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0002_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/minbystring
2014-04-09 19:32:05,068 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:32:05,069 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0002_r_000000_0' done.
2014-04-09 19:32:05,076 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/minbystring/_temporary
2014-04-09 19:32:05,093 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:05,102 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:05,103 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/minbystring
2014-04-09 19:32:05,115 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:32:05,115 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:32:05,137 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [average-lhs+average-rhs] starting
2014-04-09 19:32:05,137 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [average-lhs+average-rhs]  source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt"]
2014-04-09 19:32:05,138 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [average-lhs+average-rhs]  source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:32:05,138 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [average-lhs+average-rhs]  sink: Hfs["TextDelimited[['char', 'average']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/mergeaverage"]
2014-04-09 19:32:05,138 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [average-lhs+average-rhs]  parallel execution is enabled: false
2014-04-09 19:32:05,138 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [average-lhs+average-rhs]  starting jobs: 1
2014-04-09 19:32:05,138 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [average-lhs+average-rhs]  allocating threads: 1
2014-04-09 19:32:05,138 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [average-lhs+average-rhs] starting step: (1/1) ...persplatform/mergeaverage
2014-04-09 19:32:05,148 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:05,149 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:05,188 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [average-lhs+average-rhs] submitted hadoop job: job_local_0003
2014-04-09 19:32:05,188 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [average-lhs+average-rhs] tracking url: http://localhost:8080/
2014-04-09 19:32:05,190 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@39e93afb
2014-04-09 19:32:05,198 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:32:05,199 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:32:05,199 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:32:05,210 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:32:05,210 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:32:05,211 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:32:05,211 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:32:05,219 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:32:05,219 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(average-lhs+average-rhs)[by: average-lhs:[{1}:'char'] average-rhs:[{1}:'char']]
2014-04-09 19:32:05,219 INFO  assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:32:05,220 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:32:05,220 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 183, total: 480, max: 672
2014-04-09 19:32:05,220 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:32:05,221 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:32:05,221 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 183, total: 480, max: 672
2014-04-09 19:32:05,221 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:32:05,221 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 5, with threshold: 2
2014-04-09 19:32:05,221 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 183, total: 480, max: 672
2014-04-09 19:32:05,222 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:32:05,222 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 7, with threshold: 2
2014-04-09 19:32:05,222 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 183, total: 480, max: 672
2014-04-09 19:32:05,222 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:32:05,223 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:32:05,224 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:32:05,225 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0003_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:32:08,190 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:32:08,191 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0003_m_000000_0' done.
2014-04-09 19:32:08,194 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@4de44dc8
2014-04-09 19:32:08,195 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt
2014-04-09 19:32:08,196 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:32:08,197 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:32:08,207 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:32:08,207 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:32:08,208 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:32:08,208 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:32:08,216 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt"]
2014-04-09 19:32:08,216 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(average-lhs+average-rhs)[by: average-lhs:[{1}:'char'] average-rhs:[{1}:'char']]
2014-04-09 19:32:08,216 INFO  assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:32:08,218 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:32:08,218 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 81, total: 480, max: 672
2014-04-09 19:32:08,218 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:32:08,218 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:32:08,219 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 81, total: 480, max: 672
2014-04-09 19:32:08,219 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:32:08,219 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 5, with threshold: 2
2014-04-09 19:32:08,219 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 81, total: 480, max: 672
2014-04-09 19:32:08,219 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:32:08,220 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 7, with threshold: 2
2014-04-09 19:32:08,220 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 81, total: 480, max: 672
2014-04-09 19:32:08,220 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:32:08,220 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:32:08,221 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:32:08,222 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0003_m_000001_0 is done. And is in the process of commiting
2014-04-09 19:32:11,194 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt:0+51
2014-04-09 19:32:11,195 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0003_m_000001_0' done.
2014-04-09 19:32:11,204 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@2e107190
2014-04-09 19:32:11,204 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:32:11,206 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 2 sorted segments
2014-04-09 19:32:11,206 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 2 segments left of total size: 400 bytes
2014-04-09 19:32:11,206 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:32:11,207 INFO  hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:32:11,208 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:32:11,214 INFO  hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(average-lhs+average-rhs)[by: average-lhs:[{1}:'char'] average-rhs:[{1}:'char']]
2014-04-09 19:32:11,214 INFO  hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextDelimited[['char', 'average']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/mergeaverage"]
2014-04-09 19:32:11,218 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0003_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:32:11,218 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:32:11,219 INFO  mapred.Task (Task.java:commit(1000)) - Task attempt_local_0003_r_000000_0 is allowed to commit now
2014-04-09 19:32:11,220 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0003_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/mergeaverage
2014-04-09 19:32:14,203 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:32:14,204 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0003_r_000000_0' done.
2014-04-09 19:32:14,218 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/mergeaverage/_temporary
2014-04-09 19:32:14,230 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:14,241 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:14,242 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/mergeaverage
2014-04-09 19:32:14,250 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:32:14,250 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:32:14,263 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [shape] starting
2014-04-09 19:32:14,264 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [shape]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt"]
2014-04-09 19:32:14,264 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [shape]  sink: Hfs["TextLine[['line']->['item', 'element']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/renameall"]
2014-04-09 19:32:14,264 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [shape]  parallel execution is enabled: false
2014-04-09 19:32:14,264 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [shape]  starting jobs: 1
2014-04-09 19:32:14,264 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [shape]  allocating threads: 1
2014-04-09 19:32:14,265 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] starting step: (1/1) ...helpersplatform/renameall
2014-04-09 19:32:14,275 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:14,290 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] submitted hadoop job: job_local_0004
2014-04-09 19:32:14,290 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] tracking url: http://localhost:8080/
2014-04-09 19:32:14,292 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@38b38e49
2014-04-09 19:32:14,293 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt
2014-04-09 19:32:14,294 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 0
2014-04-09 19:32:14,296 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:32:14,296 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:32:14,300 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt"]
2014-04-09 19:32:14,300 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: Hfs["TextLine[['line']->['item', 'element']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/renameall"]
2014-04-09 19:32:14,301 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0004_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:32:14,302 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:32:14,302 INFO  mapred.Task (Task.java:commit(1000)) - Task attempt_local_0004_m_000000_0 is allowed to commit now
2014-04-09 19:32:14,304 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0004_m_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/renameall
2014-04-09 19:32:17,292 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt:0+19
2014-04-09 19:32:17,293 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0004_m_000000_0' done.
2014-04-09 19:32:17,298 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/renameall/_temporary
2014-04-09 19:32:17,309 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:17,310 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/renameall
2014-04-09 19:32:17,317 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:32:17,317 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:32:17,348 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [count] starting
2014-04-09 19:32:17,349 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [count]  source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:32:17,350 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [count]  sink: Hfs["TextDelimited[['count', 'count2']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/countcount"]
2014-04-09 19:32:17,350 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [count]  parallel execution is enabled: false
2014-04-09 19:32:17,350 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [count]  starting jobs: 2
2014-04-09 19:32:17,350 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [count]  allocating threads: 1
2014-04-09 19:32:17,350 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] starting step: (1/2)
2014-04-09 19:32:17,357 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:17,371 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] submitted hadoop job: job_local_0005
2014-04-09 19:32:17,371 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] tracking url: http://localhost:8080/
2014-04-09 19:32:17,374 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@26fc5202
2014-04-09 19:32:17,375 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:32:17,377 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:32:17,377 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:32:17,388 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:32:17,388 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:32:17,389 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:32:17,389 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:32:17,395 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:32:17,395 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(count)[by:[{1}:'char']]
2014-04-09 19:32:17,395 INFO  assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:32:17,396 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:32:17,396 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 84, total: 480, max: 672
2014-04-09 19:32:17,396 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:32:17,397 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:32:17,397 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 84, total: 480, max: 672
2014-04-09 19:32:17,397 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:32:17,397 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 5, with threshold: 2
2014-04-09 19:32:17,397 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 84, total: 480, max: 672
2014-04-09 19:32:17,397 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:32:17,398 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 7, with threshold: 2
2014-04-09 19:32:17,398 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 84, total: 480, max: 672
2014-04-09 19:32:17,398 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:32:17,398 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:32:17,399 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:32:17,400 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0005_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:32:20,374 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:32:20,375 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0005_m_000000_0' done.
2014-04-09 19:32:20,380 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@6897f7ca
2014-04-09 19:32:20,380 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:32:20,382 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 19:32:20,382 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 119 bytes
2014-04-09 19:32:20,382 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:32:20,383 INFO  hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:32:20,384 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:32:20,391 INFO  hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(count)[by:[{1}:'char']]
2014-04-09 19:32:20,392 INFO  hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: TempHfs["SequenceFile[['count', 'count2']]"][4223958462/count/]
2014-04-09 19:32:20,396 INFO  assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:32:20,397 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:32:20,397 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 80, total: 480, max: 672
2014-04-09 19:32:20,397 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:32:20,398 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0005_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:32:20,398 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:32:20,399 INFO  mapred.Task (Task.java:commit(1000)) - Task attempt_local_0005_r_000000_0 is allowed to commit now
2014-04-09 19:32:20,400 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0005_r_000000_0' to file:/tmp/hadoop-brock/4223958462_count_A23BB91DC04047C7955DA5EE5C401B8F
2014-04-09 19:32:23,379 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:32:23,381 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0005_r_000000_0' done.
2014-04-09 19:32:23,384 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] starting step: (2/2) ...elpersplatform/countcount
2014-04-09 19:32:23,393 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:23,414 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] submitted hadoop job: job_local_0006
2014-04-09 19:32:23,414 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] tracking url: http://localhost:8080/
2014-04-09 19:32:23,416 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@71474694
2014-04-09 19:32:23,416 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-brock/4223958462_count_A23BB91DC04047C7955DA5EE5C401B8F/part-00000
2014-04-09 19:32:23,419 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:32:23,420 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:32:23,430 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:32:23,430 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:32:23,431 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:32:23,431 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:32:23,436 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: TempHfs["SequenceFile[['count', 'count2']]"][4223958462/count/]
2014-04-09 19:32:23,436 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(count)[by:[{1}:'count']]
2014-04-09 19:32:23,437 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:32:23,438 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:32:23,439 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0006_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:32:26,416 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/tmp/hadoop-brock/4223958462_count_A23BB91DC04047C7955DA5EE5C401B8F/part-00000:0+112
2014-04-09 19:32:26,417 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0006_m_000000_0' done.
2014-04-09 19:32:26,421 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@10e631f
2014-04-09 19:32:26,422 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:32:26,423 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 19:32:26,423 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 29 bytes
2014-04-09 19:32:26,424 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:32:26,424 INFO  hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:32:26,425 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:32:26,432 INFO  hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(count)[by:[{1}:'count']]
2014-04-09 19:32:26,432 INFO  hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextDelimited[['count', 'count2']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/countcount"]
2014-04-09 19:32:26,434 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0006_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:32:26,435 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:32:26,435 INFO  mapred.Task (Task.java:commit(1000)) - Task attempt_local_0006_r_000000_0 is allowed to commit now
2014-04-09 19:32:26,436 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0006_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/countcount
2014-04-09 19:32:29,421 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:32:29,422 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0006_r_000000_0' done.
2014-04-09 19:32:29,429 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/countcount/_temporary
2014-04-09 19:32:29,441 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:29,447 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:29,447 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/countcount
2014-04-09 19:32:29,462 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:32:29,462 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:32:29,479 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [count-lhs+count-rhs] starting
2014-04-09 19:32:29,479 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [count-lhs+count-rhs]  source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt"]
2014-04-09 19:32:29,479 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [count-lhs+count-rhs]  source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:32:29,480 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [count-lhs+count-rhs]  sink: Hfs["TextDelimited[['char', 'count']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/mergecount"]
2014-04-09 19:32:29,480 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [count-lhs+count-rhs]  parallel execution is enabled: false
2014-04-09 19:32:29,480 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [count-lhs+count-rhs]  starting jobs: 1
2014-04-09 19:32:29,480 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [count-lhs+count-rhs]  allocating threads: 1
2014-04-09 19:32:29,481 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs+count-rhs] starting step: (1/1) ...elpersplatform/mergecount
2014-04-09 19:32:29,487 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:29,488 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:29,503 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs+count-rhs] submitted hadoop job: job_local_0007
2014-04-09 19:32:29,503 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs+count-rhs] tracking url: http://localhost:8080/
2014-04-09 19:32:29,506 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@14d21a20
2014-04-09 19:32:29,507 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:32:29,509 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:32:29,509 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:32:29,520 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:32:29,520 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:32:29,521 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:32:29,521 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:32:29,527 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:32:29,527 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(count-lhs+count-rhs)[by: count-lhs:[{1}:'char'] count-rhs:[{1}:'char']]
2014-04-09 19:32:29,527 INFO  assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:32:29,528 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:32:29,528 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 82, total: 575, max: 672
2014-04-09 19:32:29,528 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:32:29,528 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 82, total: 575, max: 672
2014-04-09 19:32:29,529 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 5, with threshold: 2
2014-04-09 19:32:29,529 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 82, total: 575, max: 672
2014-04-09 19:32:29,529 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 7, with threshold: 2
2014-04-09 19:32:29,529 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 82, total: 575, max: 672
2014-04-09 19:32:29,530 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:32:29,531 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:32:29,532 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0007_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:32:32,506 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:32:32,507 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0007_m_000000_0' done.
2014-04-09 19:32:32,509 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@30b4562b
2014-04-09 19:32:32,509 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt
2014-04-09 19:32:32,510 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:32:32,510 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:32:32,519 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:32:32,520 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:32:32,520 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:32:32,520 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:32:32,527 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt"]
2014-04-09 19:32:32,527 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(count-lhs+count-rhs)[by: count-lhs:[{1}:'char'] count-rhs:[{1}:'char']]
2014-04-09 19:32:32,527 INFO  assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:32:32,529 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:32:32,529 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 55, total: 650, max: 672
2014-04-09 19:32:32,529 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:32:32,530 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 55, total: 650, max: 672
2014-04-09 19:32:32,530 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 5, with threshold: 2
2014-04-09 19:32:32,530 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 55, total: 650, max: 672
2014-04-09 19:32:32,530 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 7, with threshold: 2
2014-04-09 19:32:32,530 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 55, total: 650, max: 672
2014-04-09 19:32:32,531 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:32:32,532 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:32:32,533 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0007_m_000001_0 is done. And is in the process of commiting
2014-04-09 19:32:35,509 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt:0+51
2014-04-09 19:32:35,510 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0007_m_000001_0' done.
2014-04-09 19:32:35,517 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@675d552b
2014-04-09 19:32:35,518 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:32:35,519 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 2 sorted segments
2014-04-09 19:32:35,519 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 2 segments left of total size: 238 bytes
2014-04-09 19:32:35,519 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:32:35,520 INFO  hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:32:35,520 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:32:35,526 INFO  hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(count-lhs+count-rhs)[by: count-lhs:[{1}:'char'] count-rhs:[{1}:'char']]
2014-04-09 19:32:35,526 INFO  hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextDelimited[['char', 'count']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/mergecount"]
2014-04-09 19:32:35,529 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0007_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:32:35,529 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:32:35,530 INFO  mapred.Task (Task.java:commit(1000)) - Task attempt_local_0007_r_000000_0 is allowed to commit now
2014-04-09 19:32:35,531 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0007_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/mergecount
2014-04-09 19:32:38,517 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:32:38,518 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0007_r_000000_0' done.
2014-04-09 19:32:38,523 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/mergecount/_temporary
2014-04-09 19:32:38,531 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:38,536 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:38,537 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/mergecount
2014-04-09 19:32:38,543 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:32:38,543 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:32:38,557 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [max] starting
2014-04-09 19:32:38,558 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [max]  source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:32:38,558 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [max]  sink: Hfs["TextDelimited[['num', 'max']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/maxbystring"]
2014-04-09 19:32:38,558 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [max]  parallel execution is enabled: false
2014-04-09 19:32:38,558 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [max]  starting jobs: 1
2014-04-09 19:32:38,558 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [max]  allocating threads: 1
2014-04-09 19:32:38,559 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [max] starting step: (1/1) ...lpersplatform/maxbystring
2014-04-09 19:32:38,569 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:38,589 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [max] submitted hadoop job: job_local_0008
2014-04-09 19:32:38,590 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [max] tracking url: http://localhost:8080/
2014-04-09 19:32:38,591 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@50a09f36
2014-04-09 19:32:38,592 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:32:38,592 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:32:38,592 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:32:38,603 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:32:38,603 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:32:38,604 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:32:38,604 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:32:38,608 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:32:38,609 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(max)[by:[{1}:'num']]
2014-04-09 19:32:38,609 INFO  assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:32:38,610 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:32:38,610 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 49, total: 631, max: 672
2014-04-09 19:32:38,610 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:32:38,610 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 49, total: 631, max: 672
2014-04-09 19:32:38,611 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:32:38,611 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:32:38,612 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0008_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:32:41,592 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:32:41,593 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0008_m_000000_0' done.
2014-04-09 19:32:41,597 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@47724e0c
2014-04-09 19:32:41,597 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:32:41,598 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 19:32:41,598 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 87 bytes
2014-04-09 19:32:41,599 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:32:41,599 INFO  hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:32:41,599 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:32:41,604 INFO  hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(max)[by:[{1}:'num']]
2014-04-09 19:32:41,604 INFO  hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextDelimited[['num', 'max']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/maxbystring"]
2014-04-09 19:32:41,606 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0008_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:32:41,607 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:32:41,607 INFO  mapred.Task (Task.java:commit(1000)) - Task attempt_local_0008_r_000000_0 is allowed to commit now
2014-04-09 19:32:41,608 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0008_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/maxbystring
2014-04-09 19:32:44,596 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:32:44,598 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0008_r_000000_0' done.
2014-04-09 19:32:44,604 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/maxbystring/_temporary
2014-04-09 19:32:44,614 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:44,621 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:44,622 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/maxbystring
2014-04-09 19:32:44,629 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:32:44,630 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:32:44,643 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [first] starting
2014-04-09 19:32:44,644 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [first]  source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:32:44,644 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [first]  sink: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/firstn"]
2014-04-09 19:32:44,644 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [first]  parallel execution is enabled: false
2014-04-09 19:32:44,644 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [first]  starting jobs: 1
2014-04-09 19:32:44,644 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [first]  allocating threads: 1
2014-04-09 19:32:44,645 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [first] starting step: (1/1) ...blyhelpersplatform/firstn
2014-04-09 19:32:44,650 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:44,663 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [first] submitted hadoop job: job_local_0009
2014-04-09 19:32:44,664 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [first] tracking url: http://localhost:8080/
2014-04-09 19:32:44,666 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@35adc18f
2014-04-09 19:32:44,666 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:32:44,667 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:32:44,667 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:32:44,684 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:32:44,684 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:32:44,686 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:32:44,686 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:32:44,694 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:32:44,694 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(first)[by:[{1}:'num']]
2014-04-09 19:32:44,695 INFO  assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:32:44,696 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:32:44,696 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 51, total: 631, max: 672
2014-04-09 19:32:44,697 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:32:44,697 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 51, total: 631, max: 672
2014-04-09 19:32:44,698 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:32:44,699 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:32:44,700 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0009_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:32:47,666 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:32:47,667 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0009_m_000000_0' done.
2014-04-09 19:32:47,671 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@7b771bf5
2014-04-09 19:32:47,671 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:32:47,673 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 19:32:47,674 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 122 bytes
2014-04-09 19:32:47,674 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:32:47,675 INFO  hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:32:47,675 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:32:47,682 INFO  hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(first)[by:[{1}:'num']]
2014-04-09 19:32:47,682 INFO  hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/firstn"]
2014-04-09 19:32:47,686 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0009_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:32:47,686 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:32:47,687 INFO  mapred.Task (Task.java:commit(1000)) - Task attempt_local_0009_r_000000_0 is allowed to commit now
2014-04-09 19:32:47,688 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0009_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/firstn
2014-04-09 19:32:50,671 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:32:50,672 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0009_r_000000_0' done.
2014-04-09 19:32:50,677 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/firstn/_temporary
2014-04-09 19:32:50,687 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:50,689 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/firstn
2014-04-09 19:32:50,700 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:32:50,700 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:32:50,710 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [coerce] starting
2014-04-09 19:32:50,710 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [coerce]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt"]
2014-04-09 19:32:50,711 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [coerce]  sink: Hfs["TextLine[['line']->['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/coercefields"]
2014-04-09 19:32:50,711 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [coerce]  parallel execution is enabled: false
2014-04-09 19:32:50,711 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [coerce]  starting jobs: 1
2014-04-09 19:32:50,711 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [coerce]  allocating threads: 1
2014-04-09 19:32:50,711 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [coerce] starting step: (1/1) ...persplatform/coercefields
2014-04-09 19:32:50,720 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:50,731 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [coerce] submitted hadoop job: job_local_0010
2014-04-09 19:32:50,731 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [coerce] tracking url: http://localhost:8080/
2014-04-09 19:32:50,732 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@ebeb918
2014-04-09 19:32:50,733 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt
2014-04-09 19:32:50,734 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 0
2014-04-09 19:32:50,736 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:32:50,736 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:32:50,742 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt"]
2014-04-09 19:32:50,742 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: Hfs["TextLine[['line']->['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/coercefields"]
2014-04-09 19:32:50,745 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0010_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:32:50,746 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:32:50,746 INFO  mapred.Task (Task.java:commit(1000)) - Task attempt_local_0010_m_000000_0 is allowed to commit now
2014-04-09 19:32:50,747 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0010_m_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/coercefields
2014-04-09 19:32:53,732 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt:0+19
2014-04-09 19:32:53,734 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0010_m_000000_0' done.
2014-04-09 19:32:53,739 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/coercefields/_temporary
2014-04-09 19:32:53,748 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:53,749 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/coercefields
2014-04-09 19:32:53,754 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:32:53,755 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:32:53,764 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [count] starting
2014-04-09 19:32:53,764 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [count]  source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:32:53,764 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [count]  sink: Hfs["TextDelimited[['char', 'count']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/count"]
2014-04-09 19:32:53,764 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [count]  parallel execution is enabled: false
2014-04-09 19:32:53,765 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [count]  starting jobs: 1
2014-04-09 19:32:53,765 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [count]  allocating threads: 1
2014-04-09 19:32:53,765 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] starting step: (1/1) ...mblyhelpersplatform/count
2014-04-09 19:32:53,775 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:53,795 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] submitted hadoop job: job_local_0011
2014-04-09 19:32:53,795 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] tracking url: http://localhost:8080/
2014-04-09 19:32:53,798 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@724d7044
2014-04-09 19:32:53,799 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:32:53,799 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:32:53,800 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:32:53,810 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:32:53,810 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:32:53,811 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:32:53,811 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:32:53,815 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:32:53,815 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(count)[by:[{1}:'char']]
2014-04-09 19:32:53,816 INFO  assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:32:53,816 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:32:53,816 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 38, total: 621, max: 672
2014-04-09 19:32:53,817 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:32:53,817 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 38, total: 621, max: 672
2014-04-09 19:32:53,817 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 5, with threshold: 2
2014-04-09 19:32:53,817 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 38, total: 621, max: 672
2014-04-09 19:32:53,817 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 7, with threshold: 2
2014-04-09 19:32:53,817 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 38, total: 621, max: 672
2014-04-09 19:32:53,818 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:32:53,819 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:32:53,819 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0011_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:32:56,799 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:32:56,800 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0011_m_000000_0' done.
2014-04-09 19:32:56,803 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@5f5dbf82
2014-04-09 19:32:56,803 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:32:56,805 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 19:32:56,805 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 119 bytes
2014-04-09 19:32:56,805 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:32:56,806 INFO  hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:32:56,806 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:32:56,812 INFO  hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(count)[by:[{1}:'char']]
2014-04-09 19:32:56,812 INFO  hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextDelimited[['char', 'count']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/count"]
2014-04-09 19:32:56,814 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0011_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:32:56,815 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:32:56,815 INFO  mapred.Task (Task.java:commit(1000)) - Task attempt_local_0011_r_000000_0 is allowed to commit now
2014-04-09 19:32:56,816 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0011_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/count
2014-04-09 19:32:59,803 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:32:59,804 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0011_r_000000_0' done.
2014-04-09 19:32:59,810 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/count/_temporary
2014-04-09 19:32:59,819 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:59,824 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:59,824 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/count
2014-04-09 19:32:59,829 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:32:59,830 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:32:59,838 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [max] starting
2014-04-09 19:32:59,839 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [max]  source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:32:59,839 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [max]  sink: Hfs["TextDelimited[['char', 'max']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/maxby"]
2014-04-09 19:32:59,839 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [max]  parallel execution is enabled: false
2014-04-09 19:32:59,839 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [max]  starting jobs: 1
2014-04-09 19:32:59,839 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [max]  allocating threads: 1
2014-04-09 19:32:59,840 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [max] starting step: (1/1) ...mblyhelpersplatform/maxby
2014-04-09 19:32:59,845 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:59,857 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [max] submitted hadoop job: job_local_0012
2014-04-09 19:32:59,857 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [max] tracking url: http://localhost:8080/
2014-04-09 19:32:59,860 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@6bd0757e
2014-04-09 19:32:59,861 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:32:59,862 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:32:59,862 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:32:59,878 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:32:59,878 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:32:59,879 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:32:59,879 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:32:59,884 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:32:59,884 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(max)[by:[{1}:'char']]
2014-04-09 19:32:59,884 INFO  assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:32:59,884 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:32:59,884 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 46, total: 627, max: 672
2014-04-09 19:32:59,885 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:32:59,885 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 46, total: 627, max: 672
2014-04-09 19:32:59,885 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 5, with threshold: 2
2014-04-09 19:32:59,885 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 46, total: 627, max: 672
2014-04-09 19:32:59,886 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 7, with threshold: 2
2014-04-09 19:32:59,886 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 46, total: 627, max: 672
2014-04-09 19:32:59,886 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:32:59,887 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:32:59,888 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0012_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:33:02,860 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:33:02,861 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0012_m_000000_0' done.
2014-04-09 19:33:02,864 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@1b020bff
2014-04-09 19:33:02,864 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:33:02,866 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 19:33:02,866 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 155 bytes
2014-04-09 19:33:02,866 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:33:02,867 INFO  hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:33:02,867 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:33:02,872 INFO  hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(max)[by:[{1}:'char']]
2014-04-09 19:33:02,872 INFO  hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextDelimited[['char', 'max']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/maxby"]
2014-04-09 19:33:02,874 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0012_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:33:02,875 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:33:02,875 INFO  mapred.Task (Task.java:commit(1000)) - Task attempt_local_0012_r_000000_0 is allowed to commit now
2014-04-09 19:33:02,876 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0012_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/maxby
2014-04-09 19:33:05,864 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:33:05,865 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0012_r_000000_0' done.
2014-04-09 19:33:05,871 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/maxby/_temporary
2014-04-09 19:33:05,880 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:05,884 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:05,885 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/maxby
2014-04-09 19:33:05,890 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:33:05,890 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:33:05,899 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [min] starting
2014-04-09 19:33:05,899 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [min]  source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:33:05,899 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [min]  sink: Hfs["TextDelimited[['char', 'min']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/minby"]
2014-04-09 19:33:05,899 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [min]  parallel execution is enabled: false
2014-04-09 19:33:05,899 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [min]  starting jobs: 1
2014-04-09 19:33:05,899 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [min]  allocating threads: 1
2014-04-09 19:33:05,900 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [min] starting step: (1/1) ...mblyhelpersplatform/minby
2014-04-09 19:33:05,907 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:05,917 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [min] submitted hadoop job: job_local_0013
2014-04-09 19:33:05,917 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [min] tracking url: http://localhost:8080/
2014-04-09 19:33:05,919 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@683df7bd
2014-04-09 19:33:05,920 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:33:05,921 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:33:05,921 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:33:05,936 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:33:05,936 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:33:05,937 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:33:05,937 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:33:05,941 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:33:05,941 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(min)[by:[{1}:'char']]
2014-04-09 19:33:05,942 INFO  assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:33:05,942 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:33:05,942 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 34, total: 615, max: 672
2014-04-09 19:33:05,942 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:33:05,943 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 34, total: 615, max: 672
2014-04-09 19:33:05,943 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 5, with threshold: 2
2014-04-09 19:33:05,943 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 34, total: 615, max: 672
2014-04-09 19:33:05,943 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 7, with threshold: 2
2014-04-09 19:33:05,943 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 34, total: 615, max: 672
2014-04-09 19:33:05,943 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:33:05,944 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:33:05,945 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0013_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:33:08,920 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:33:08,921 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0013_m_000000_0' done.
2014-04-09 19:33:08,924 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@3c08e293
2014-04-09 19:33:08,924 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:33:08,926 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 19:33:08,926 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 155 bytes
2014-04-09 19:33:08,926 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:33:08,928 INFO  hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:33:08,928 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:33:08,932 INFO  hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(min)[by:[{1}:'char']]
2014-04-09 19:33:08,932 INFO  hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextDelimited[['char', 'min']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/minby"]
2014-04-09 19:33:08,935 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0013_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:33:08,935 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:33:08,935 INFO  mapred.Task (Task.java:commit(1000)) - Task attempt_local_0013_r_000000_0 is allowed to commit now
2014-04-09 19:33:08,936 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0013_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/minby
2014-04-09 19:33:11,924 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:33:11,925 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0013_r_000000_0' done.
2014-04-09 19:33:11,929 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/minby/_temporary
2014-04-09 19:33:11,938 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:11,942 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:11,943 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/minby
2014-04-09 19:33:11,948 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:33:11,948 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:33:11,957 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [sum] starting
2014-04-09 19:33:11,957 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [sum]  source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:33:11,958 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [sum]  sink: Hfs["TextDelimited[['char', 'sum']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/sum"]
2014-04-09 19:33:11,958 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [sum]  parallel execution is enabled: false
2014-04-09 19:33:11,958 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [sum]  starting jobs: 1
2014-04-09 19:33:11,958 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [sum]  allocating threads: 1
2014-04-09 19:33:11,958 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [sum] starting step: (1/1) ...semblyhelpersplatform/sum
2014-04-09 19:33:11,967 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:11,981 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [sum] submitted hadoop job: job_local_0014
2014-04-09 19:33:11,981 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [sum] tracking url: http://localhost:8080/
2014-04-09 19:33:11,983 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@2b938c68
2014-04-09 19:33:11,983 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:33:11,984 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:33:11,984 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:33:11,995 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:33:11,996 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:33:11,996 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:33:11,996 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:33:12,001 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:33:12,001 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(sum)[by:[{1}:'char']]
2014-04-09 19:33:12,001 INFO  assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:33:12,002 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:33:12,002 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 39, total: 622, max: 672
2014-04-09 19:33:12,002 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:33:12,002 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 39, total: 622, max: 672
2014-04-09 19:33:12,003 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 5, with threshold: 2
2014-04-09 19:33:12,003 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 39, total: 622, max: 672
2014-04-09 19:33:12,003 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 7, with threshold: 2
2014-04-09 19:33:12,003 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 39, total: 622, max: 672
2014-04-09 19:33:12,003 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:33:12,004 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:33:12,005 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0014_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:33:14,983 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:33:14,984 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0014_m_000000_0' done.
2014-04-09 19:33:14,987 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@40d638d
2014-04-09 19:33:14,988 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:33:14,989 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 19:33:14,989 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 119 bytes
2014-04-09 19:33:14,989 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:33:14,989 INFO  hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:33:14,989 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:33:14,994 INFO  hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(sum)[by:[{1}:'char']]
2014-04-09 19:33:14,994 INFO  hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextDelimited[['char', 'sum']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/sum"]
2014-04-09 19:33:14,996 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0014_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:33:14,996 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:33:14,997 INFO  mapred.Task (Task.java:commit(1000)) - Task attempt_local_0014_r_000000_0 is allowed to commit now
2014-04-09 19:33:14,997 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0014_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/sum
2014-04-09 19:33:17,987 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:33:17,989 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0014_r_000000_0' done.
2014-04-09 19:33:17,997 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/sum/_temporary
2014-04-09 19:33:18,002 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:18,006 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:18,007 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/sum
2014-04-09 19:33:18,013 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:33:18,013 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:33:18,029 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [sum-lhs+sum-rhs] starting
2014-04-09 19:33:18,030 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [sum-lhs+sum-rhs]  source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt"]
2014-04-09 19:33:18,030 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [sum-lhs+sum-rhs]  source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:33:18,030 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [sum-lhs+sum-rhs]  sink: Hfs["TextDelimited[['char', 'sum']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/mergesum"]
2014-04-09 19:33:18,030 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [sum-lhs+sum-rhs]  parallel execution is enabled: false
2014-04-09 19:33:18,030 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [sum-lhs+sum-rhs]  starting jobs: 1
2014-04-09 19:33:18,030 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [sum-lhs+sum-rhs]  allocating threads: 1
2014-04-09 19:33:18,031 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [sum-lhs+sum-rhs] starting step: (1/1) ...yhelpersplatform/mergesum
2014-04-09 19:33:18,035 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:18,035 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:18,044 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [sum-lhs+sum-rhs] submitted hadoop job: job_local_0015
2014-04-09 19:33:18,045 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [sum-lhs+sum-rhs] tracking url: http://localhost:8080/
2014-04-09 19:33:18,047 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@2058690e
2014-04-09 19:33:18,048 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:33:18,049 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:33:18,049 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:33:18,060 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:33:18,061 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:33:18,061 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:33:18,061 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:33:18,066 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:33:18,067 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(sum-lhs+sum-rhs)[by: sum-lhs:[{1}:'char'] sum-rhs:[{1}:'char']]
2014-04-09 19:33:18,067 INFO  assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:33:18,067 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:33:18,067 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 24, total: 610, max: 672
2014-04-09 19:33:18,068 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:33:18,068 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 24, total: 610, max: 672
2014-04-09 19:33:18,068 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 5, with threshold: 2
2014-04-09 19:33:18,068 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 24, total: 610, max: 672
2014-04-09 19:33:18,069 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 7, with threshold: 2
2014-04-09 19:33:18,069 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 24, total: 610, max: 672
2014-04-09 19:33:18,069 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:33:18,070 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:33:18,071 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0015_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:33:21,047 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:33:21,048 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0015_m_000000_0' done.
2014-04-09 19:33:21,058 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@15b3f6a8
2014-04-09 19:33:21,060 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt
2014-04-09 19:33:21,061 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:33:21,061 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:33:21,074 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:33:21,074 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:33:21,075 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:33:21,075 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:33:21,080 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt"]
2014-04-09 19:33:21,080 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(sum-lhs+sum-rhs)[by: sum-lhs:[{1}:'char'] sum-rhs:[{1}:'char']]
2014-04-09 19:33:21,081 INFO  assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:33:21,082 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:33:21,083 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 35, total: 616, max: 672
2014-04-09 19:33:21,083 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:33:21,083 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 35, total: 616, max: 672
2014-04-09 19:33:21,084 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 5, with threshold: 2
2014-04-09 19:33:21,084 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 35, total: 616, max: 672
2014-04-09 19:33:21,084 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 7, with threshold: 2
2014-04-09 19:33:21,084 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 35, total: 616, max: 672
2014-04-09 19:33:21,084 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:33:21,085 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:33:21,086 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0015_m_000001_0 is done. And is in the process of commiting
2014-04-09 19:33:24,050 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt:0+51
2014-04-09 19:33:24,051 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0015_m_000001_0' done.
2014-04-09 19:33:24,056 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@6a738a66
2014-04-09 19:33:24,056 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:33:24,058 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 2 sorted segments
2014-04-09 19:33:24,058 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 2 segments left of total size: 238 bytes
2014-04-09 19:33:24,058 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:33:24,059 INFO  hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:33:24,059 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:33:24,064 INFO  hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(sum-lhs+sum-rhs)[by: sum-lhs:[{1}:'char'] sum-rhs:[{1}:'char']]
2014-04-09 19:33:24,064 INFO  hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextDelimited[['char', 'sum']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/mergesum"]
2014-04-09 19:33:24,066 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0015_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:33:24,067 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:33:24,067 INFO  mapred.Task (Task.java:commit(1000)) - Task attempt_local_0015_r_000000_0 is allowed to commit now
2014-04-09 19:33:24,068 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0015_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/mergesum
2014-04-09 19:33:27,056 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:33:27,057 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0015_r_000000_0' done.
2014-04-09 19:33:27,061 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/mergesum/_temporary
2014-04-09 19:33:27,071 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:27,075 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:27,076 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/mergesum
2014-04-09 19:33:27,080 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:33:27,080 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:33:27,087 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [shape] starting
2014-04-09 19:33:27,087 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [shape]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt"]
2014-04-09 19:33:27,087 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [shape]  sink: Hfs["TextLine[['num']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/discardnarrow"]
2014-04-09 19:33:27,087 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [shape]  parallel execution is enabled: false
2014-04-09 19:33:27,088 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [shape]  starting jobs: 1
2014-04-09 19:33:27,088 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [shape]  allocating threads: 1
2014-04-09 19:33:27,088 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] starting step: (1/1) ...ersplatform/discardnarrow
2014-04-09 19:33:27,096 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:27,105 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] submitted hadoop job: job_local_0016
2014-04-09 19:33:27,106 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] tracking url: http://localhost:8080/
2014-04-09 19:33:27,108 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@6a45ec3d
2014-04-09 19:33:27,109 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt
2014-04-09 19:33:27,110 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 0
2014-04-09 19:33:27,112 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:33:27,112 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:33:27,119 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt"]
2014-04-09 19:33:27,119 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: Hfs["TextLine[['num']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/discardnarrow"]
2014-04-09 19:33:27,119 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0016_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:33:27,120 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:33:27,120 INFO  mapred.Task (Task.java:commit(1000)) - Task attempt_local_0016_m_000000_0 is allowed to commit now
2014-04-09 19:33:27,121 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0016_m_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/discardnarrow
2014-04-09 19:33:30,108 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt:0+19
2014-04-09 19:33:30,109 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0016_m_000000_0' done.
2014-04-09 19:33:30,113 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/discardnarrow/_temporary
2014-04-09 19:33:30,120 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:30,121 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/discardnarrow
2014-04-09 19:33:30,125 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:33:30,126 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:33:30,131 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [shape] starting
2014-04-09 19:33:30,132 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [shape]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt"]
2014-04-09 19:33:30,132 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [shape]  sink: Hfs["TextLine[['line']->['item', 'element']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/rename"]
2014-04-09 19:33:30,132 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [shape]  parallel execution is enabled: false
2014-04-09 19:33:30,132 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [shape]  starting jobs: 1
2014-04-09 19:33:30,132 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [shape]  allocating threads: 1
2014-04-09 19:33:30,133 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] starting step: (1/1) ...blyhelpersplatform/rename
2014-04-09 19:33:30,139 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:30,147 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] submitted hadoop job: job_local_0017
2014-04-09 19:33:30,147 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] tracking url: http://localhost:8080/
2014-04-09 19:33:30,149 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@580d63fe
2014-04-09 19:33:30,150 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt
2014-04-09 19:33:30,151 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 0
2014-04-09 19:33:30,153 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:33:30,154 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:33:30,159 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt"]
2014-04-09 19:33:30,159 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: Hfs["TextLine[['line']->['item', 'element']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/rename"]
2014-04-09 19:33:30,160 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0017_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:33:30,160 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:33:30,160 INFO  mapred.Task (Task.java:commit(1000)) - Task attempt_local_0017_m_000000_0 is allowed to commit now
2014-04-09 19:33:30,161 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0017_m_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/rename
2014-04-09 19:33:33,149 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt:0+19
2014-04-09 19:33:33,150 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0017_m_000000_0' done.
2014-04-09 19:33:33,154 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/rename/_temporary
2014-04-09 19:33:33,161 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:33,162 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/rename
2014-04-09 19:33:33,168 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:33:33,169 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:33:33,184 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [name] starting
2014-04-09 19:33:33,184 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [name]  source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt"]
2014-04-09 19:33:33,184 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [name]  source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:33:33,184 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [name]  sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/multimerge+true"]
2014-04-09 19:33:33,184 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [name]  parallel execution is enabled: false
2014-04-09 19:33:33,185 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [name]  starting jobs: 1
2014-04-09 19:33:33,185 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [name]  allocating threads: 1
2014-04-09 19:33:33,185 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [name] starting step: (1/1) ...splatform/multimerge+true
2014-04-09 19:33:33,190 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:33,190 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:33,198 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [name] submitted hadoop job: job_local_0018
2014-04-09 19:33:33,198 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [name] tracking url: http://localhost:8080/
2014-04-09 19:33:33,200 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@ec64756
2014-04-09 19:33:33,201 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:33:33,202 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:33:33,202 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:33:33,284 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:33:33,284 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:33:33,285 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:33:33,285 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:33:33,295 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:33:33,295 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2014-04-09 19:33:33,296 INFO  assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:33:33,297 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:33:33,297 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 242, total: 348, max: 672
2014-04-09 19:33:33,297 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 51% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:33:33,298 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:33:33,298 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 242, total: 348, max: 672
2014-04-09 19:33:33,298 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 51% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:33:33,299 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 5, with threshold: 2
2014-04-09 19:33:33,299 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 242, total: 348, max: 672
2014-04-09 19:33:33,299 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 51% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:33:33,299 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 7, with threshold: 2
2014-04-09 19:33:33,299 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 242, total: 348, max: 672
2014-04-09 19:33:33,299 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 51% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:33:33,300 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:33:33,301 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:33:33,301 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0018_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:33:36,200 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:33:36,201 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0018_m_000000_0' done.
2014-04-09 19:33:36,203 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@341e00e1
2014-04-09 19:33:36,204 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt
2014-04-09 19:33:36,205 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:33:36,205 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:33:36,217 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:33:36,217 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:33:36,217 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:33:36,217 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:33:36,225 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt"]
2014-04-09 19:33:36,225 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2014-04-09 19:33:36,225 INFO  assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:33:36,227 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:33:36,227 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 139, total: 348, max: 672
2014-04-09 19:33:36,227 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 51% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:33:36,227 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:33:36,227 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 139, total: 348, max: 672
2014-04-09 19:33:36,227 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 51% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:33:36,228 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 5, with threshold: 2
2014-04-09 19:33:36,228 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 139, total: 348, max: 672
2014-04-09 19:33:36,228 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 51% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:33:36,228 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 7, with threshold: 2
2014-04-09 19:33:36,229 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 139, total: 348, max: 672
2014-04-09 19:33:36,229 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 51% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:33:36,229 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:33:36,230 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:33:36,230 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0018_m_000001_0 is done. And is in the process of commiting
2014-04-09 19:33:39,203 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt:0+51
2014-04-09 19:33:39,204 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0018_m_000001_0' done.
2014-04-09 19:33:39,208 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@769ceb67
2014-04-09 19:33:39,209 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:33:39,209 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 2 sorted segments
2014-04-09 19:33:39,209 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 2 segments left of total size: 472 bytes
2014-04-09 19:33:39,210 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:33:39,210 INFO  hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:33:39,210 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:33:39,216 INFO  hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(name)[by:[{1}:'char']]
2014-04-09 19:33:39,216 INFO  hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/multimerge+true"]
2014-04-09 19:33:39,219 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0018_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:33:39,219 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:33:39,219 INFO  mapred.Task (Task.java:commit(1000)) - Task attempt_local_0018_r_000000_0 is allowed to commit now
2014-04-09 19:33:39,220 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0018_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/multimerge+true
2014-04-09 19:33:42,208 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:33:42,210 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0018_r_000000_0' done.
2014-04-09 19:33:42,221 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/multimerge+true/_temporary
2014-04-09 19:33:42,230 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:42,239 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:42,239 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/multimerge+true
2014-04-09 19:33:42,245 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:33:42,245 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:33:42,270 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [second] starting
2014-04-09 19:33:42,270 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [second]  source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:33:42,270 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [second]  sink: Hfs["TextDelimited[['char', 'count']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/samesourcemergecount"]
2014-04-09 19:33:42,270 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [second]  parallel execution is enabled: false
2014-04-09 19:33:42,271 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [second]  starting jobs: 2
2014-04-09 19:33:42,271 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [second]  allocating threads: 1
2014-04-09 19:33:42,271 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [second] starting step: (1/2)
2014-04-09 19:33:42,279 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:42,292 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [second] submitted hadoop job: job_local_0019
2014-04-09 19:33:42,292 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [second] tracking url: http://localhost:8080/
2014-04-09 19:33:42,294 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@71fecc5e
2014-04-09 19:33:42,295 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:33:42,296 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:33:42,296 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:33:42,307 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:33:42,307 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:33:42,308 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:33:42,308 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:33:42,313 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:33:42,313 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(first)[by:[{1}:'char']]
2014-04-09 19:33:42,313 INFO  assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:33:42,315 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:33:42,315 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 120, total: 443, max: 672
2014-04-09 19:33:42,315 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 65% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:33:42,315 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:33:42,316 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 120, total: 443, max: 672
2014-04-09 19:33:42,316 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 65% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:33:42,316 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 5, with threshold: 2
2014-04-09 19:33:42,316 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 120, total: 443, max: 672
2014-04-09 19:33:42,316 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 65% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:33:42,316 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 7, with threshold: 2
2014-04-09 19:33:42,316 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 120, total: 443, max: 672
2014-04-09 19:33:42,316 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 65% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:33:42,317 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:33:42,318 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:33:42,318 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0019_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:33:45,294 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:33:45,295 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0019_m_000000_0' done.
2014-04-09 19:33:45,298 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@3899abfc
2014-04-09 19:33:45,298 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:33:45,299 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 19:33:45,299 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 119 bytes
2014-04-09 19:33:45,299 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:33:45,300 INFO  hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:33:45,300 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:33:45,304 INFO  hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(first)[by:[{1}:'char']]
2014-04-09 19:33:45,304 INFO  hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: TempHfs["SequenceFile[['char', 'count']]"][457268092/first/]
2014-04-09 19:33:45,306 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0019_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:33:45,306 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:33:45,306 INFO  mapred.Task (Task.java:commit(1000)) - Task attempt_local_0019_r_000000_0 is allowed to commit now
2014-04-09 19:33:45,307 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0019_r_000000_0' to file:/tmp/hadoop-brock/457268092_first_4C4A60FD4C1B4E8B918C5014C76416B8
2014-04-09 19:33:48,298 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:33:48,299 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0019_r_000000_0' done.
2014-04-09 19:33:48,302 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [second] starting step: (2/2) ...form/samesourcemergecount
2014-04-09 19:33:48,309 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:48,322 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [second] submitted hadoop job: job_local_0020
2014-04-09 19:33:48,322 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [second] tracking url: http://localhost:8080/
2014-04-09 19:33:48,325 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@24fa5c93
2014-04-09 19:33:48,326 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-brock/457268092_first_4C4A60FD4C1B4E8B918C5014C76416B8/part-00000
2014-04-09 19:33:48,327 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:33:48,327 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:33:48,337 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:33:48,337 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:33:48,338 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:33:48,338 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:33:48,345 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][457268092/first/]
2014-04-09 19:33:48,345 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(second)[by:[{1}:'char']]
2014-04-09 19:33:48,345 INFO  assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:33:48,346 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:33:48,346 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 109, total: 538, max: 672
2014-04-09 19:33:48,347 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:33:48,347 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 109, total: 538, max: 672
2014-04-09 19:33:48,347 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:33:48,348 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:33:48,349 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0020_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:33:51,325 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/tmp/hadoop-brock/457268092_first_4C4A60FD4C1B4E8B918C5014C76416B8/part-00000:0+160
2014-04-09 19:33:51,326 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0020_m_000000_0' done.
2014-04-09 19:33:51,328 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@30cc684b
2014-04-09 19:33:51,328 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:33:51,329 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 19:33:51,329 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 67 bytes
2014-04-09 19:33:51,329 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:33:51,330 INFO  hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:33:51,330 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:33:51,334 INFO  hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(second)[by:[{1}:'char']]
2014-04-09 19:33:51,335 INFO  hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextDelimited[['char', 'count']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/samesourcemergecount"]
2014-04-09 19:33:51,336 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0020_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:33:51,337 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:33:51,337 INFO  mapred.Task (Task.java:commit(1000)) - Task attempt_local_0020_r_000000_0 is allowed to commit now
2014-04-09 19:33:51,338 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0020_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/samesourcemergecount
2014-04-09 19:33:54,328 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:33:54,329 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0020_r_000000_0' done.
2014-04-09 19:33:54,333 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/samesourcemergecount/_temporary
2014-04-09 19:33:54,342 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:54,349 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:54,350 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/samesourcemergecount
2014-04-09 19:33:54,355 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:33:54,355 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:33:54,364 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [average] starting
2014-04-09 19:33:54,364 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [average]  source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:33:54,364 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [average]  sink: Hfs["TextDelimited[['char', 'average']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/average"]
2014-04-09 19:33:54,364 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [average]  parallel execution is enabled: false
2014-04-09 19:33:54,364 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [average]  starting jobs: 1
2014-04-09 19:33:54,364 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [average]  allocating threads: 1
2014-04-09 19:33:54,365 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [average] starting step: (1/1) ...lyhelpersplatform/average
2014-04-09 19:33:54,370 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:54,380 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [average] submitted hadoop job: job_local_0021
2014-04-09 19:33:54,380 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [average] tracking url: http://localhost:8080/
2014-04-09 19:33:54,382 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@3cf79190
2014-04-09 19:33:54,383 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:33:54,384 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:33:54,384 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:33:54,396 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:33:54,396 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:33:54,397 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:33:54,397 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:33:54,401 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:33:54,401 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(average)[by:[{1}:'char']]
2014-04-09 19:33:54,401 INFO  assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:33:54,402 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:33:54,402 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 70, total: 611, max: 672
2014-04-09 19:33:54,402 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:33:54,402 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 70, total: 611, max: 672
2014-04-09 19:33:54,403 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 5, with threshold: 2
2014-04-09 19:33:54,403 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 70, total: 611, max: 672
2014-04-09 19:33:54,403 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 7, with threshold: 2
2014-04-09 19:33:54,403 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 70, total: 611, max: 672
2014-04-09 19:33:54,404 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:33:54,405 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:33:54,406 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0021_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:33:57,382 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:33:57,383 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0021_m_000000_0' done.
2014-04-09 19:33:57,386 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@5bb111eb
2014-04-09 19:33:57,386 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:33:57,387 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 19:33:57,388 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 200 bytes
2014-04-09 19:33:57,388 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:33:57,388 INFO  hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:33:57,388 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:33:57,392 INFO  hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(average)[by:[{1}:'char']]
2014-04-09 19:33:57,392 INFO  hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextDelimited[['char', 'average']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/average"]
2014-04-09 19:33:57,394 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0021_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:33:57,394 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:33:57,395 INFO  mapred.Task (Task.java:commit(1000)) - Task attempt_local_0021_r_000000_0 is allowed to commit now
2014-04-09 19:33:57,396 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0021_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/average
2014-04-09 19:34:00,386 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:34:00,387 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0021_r_000000_0' done.
2014-04-09 19:34:00,396 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/average/_temporary
2014-04-09 19:34:00,400 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:00,404 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:00,404 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/average
2014-04-09 19:34:00,410 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:34:00,410 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:34:00,418 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [sum] starting
2014-04-09 19:34:00,418 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [sum]  source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:34:00,419 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [sum]  sink: Hfs["TextDelimited[['char', 'sum']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/sumnulls"]
2014-04-09 19:34:00,419 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [sum]  parallel execution is enabled: false
2014-04-09 19:34:00,419 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [sum]  starting jobs: 1
2014-04-09 19:34:00,419 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [sum]  allocating threads: 1
2014-04-09 19:34:00,420 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [sum] starting step: (1/1) ...yhelpersplatform/sumnulls
2014-04-09 19:34:00,427 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:00,435 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [sum] submitted hadoop job: job_local_0022
2014-04-09 19:34:00,435 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [sum] tracking url: http://localhost:8080/
2014-04-09 19:34:00,437 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@3d63d4c4
2014-04-09 19:34:00,438 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:34:00,439 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:34:00,439 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:34:00,503 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:34:00,503 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:34:00,504 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:34:00,504 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:34:00,508 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:34:00,508 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(sum)[by:[{1}:'char']]
2014-04-09 19:34:00,509 INFO  assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:34:00,511 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:34:00,512 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 245, total: 352, max: 672
2014-04-09 19:34:00,512 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 52% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:34:00,512 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:34:00,512 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 245, total: 352, max: 672
2014-04-09 19:34:00,512 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 52% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:34:00,513 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 5, with threshold: 2
2014-04-09 19:34:00,513 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 245, total: 352, max: 672
2014-04-09 19:34:00,513 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 52% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:34:00,513 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 7, with threshold: 2
2014-04-09 19:34:00,513 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 245, total: 352, max: 672
2014-04-09 19:34:00,513 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 52% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:34:00,514 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:34:00,515 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:34:00,516 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0022_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:34:03,438 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:34:03,439 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0022_m_000000_0' done.
2014-04-09 19:34:03,441 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@cc270ff
2014-04-09 19:34:03,442 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:34:03,443 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 19:34:03,443 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 116 bytes
2014-04-09 19:34:03,443 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:34:03,444 INFO  hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:34:03,444 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:34:03,450 INFO  hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(sum)[by:[{1}:'char']]
2014-04-09 19:34:03,450 INFO  hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextDelimited[['char', 'sum']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/sumnulls"]
2014-04-09 19:34:03,452 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0022_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:34:03,452 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:34:03,453 INFO  mapred.Task (Task.java:commit(1000)) - Task attempt_local_0022_r_000000_0 is allowed to commit now
2014-04-09 19:34:03,453 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0022_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/sumnulls
2014-04-09 19:34:06,441 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:34:06,442 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0022_r_000000_0' done.
2014-04-09 19:34:06,451 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/sumnulls/_temporary
2014-04-09 19:34:06,460 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:06,468 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:06,469 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/sumnulls
2014-04-09 19:34:06,474 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:34:06,474 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:34:06,480 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [count] starting
2014-04-09 19:34:06,481 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [count]  source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:34:06,481 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [count]  sink: Hfs["TextDelimited[['count']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/countall"]
2014-04-09 19:34:06,481 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [count]  parallel execution is enabled: false
2014-04-09 19:34:06,481 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [count]  starting jobs: 1
2014-04-09 19:34:06,481 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [count]  allocating threads: 1
2014-04-09 19:34:06,481 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] starting step: (1/1) ...yhelpersplatform/countall
2014-04-09 19:34:06,484 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:06,494 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] submitted hadoop job: job_local_0023
2014-04-09 19:34:06,494 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] tracking url: http://localhost:8080/
2014-04-09 19:34:06,496 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@1f34f843
2014-04-09 19:34:06,497 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:34:06,498 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:34:06,499 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:34:06,509 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:34:06,509 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:34:06,509 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:34:06,509 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:34:06,514 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:34:06,515 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(count)[by:[{?}:NONE]]
2014-04-09 19:34:06,515 INFO  assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:34:06,516 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:34:06,517 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:34:06,518 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0023_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:34:09,497 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:34:09,498 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0023_m_000000_0' done.
2014-04-09 19:34:09,500 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@48ace6b4
2014-04-09 19:34:09,500 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:34:09,502 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 19:34:09,502 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 8 bytes
2014-04-09 19:34:09,502 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:34:09,503 INFO  hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:34:09,503 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:34:09,509 INFO  hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(count)[by:[{?}:NONE]]
2014-04-09 19:34:09,509 INFO  hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextDelimited[['count']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/countall"]
2014-04-09 19:34:09,511 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0023_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:34:09,511 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:34:09,511 INFO  mapred.Task (Task.java:commit(1000)) - Task attempt_local_0023_r_000000_0 is allowed to commit now
2014-04-09 19:34:09,512 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0023_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/countall
2014-04-09 19:34:12,500 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:34:12,501 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0023_r_000000_0' done.
2014-04-09 19:34:12,504 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/countall/_temporary
2014-04-09 19:34:12,511 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:12,514 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:12,515 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/countall
2014-04-09 19:34:12,520 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:34:12,521 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:34:12,530 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [name] starting
2014-04-09 19:34:12,531 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [name]  source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:34:12,531 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [name]  sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average', 'average2', 'first']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/multi"]
2014-04-09 19:34:12,531 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [name]  parallel execution is enabled: false
2014-04-09 19:34:12,531 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [name]  starting jobs: 1
2014-04-09 19:34:12,531 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [name]  allocating threads: 1
2014-04-09 19:34:12,531 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [name] starting step: (1/1) ...mblyhelpersplatform/multi
2014-04-09 19:34:12,535 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:12,543 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [name] submitted hadoop job: job_local_0024
2014-04-09 19:34:12,543 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [name] tracking url: http://localhost:8080/
2014-04-09 19:34:12,544 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@7ad138dd
2014-04-09 19:34:12,544 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:34:12,545 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:34:12,545 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:34:12,556 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:34:12,556 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:34:12,557 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:34:12,557 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:34:12,561 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:34:12,561 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2014-04-09 19:34:12,561 INFO  assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:34:12,562 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:34:12,562 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 115, total: 447, max: 672
2014-04-09 19:34:12,562 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 66% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:34:12,563 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:34:12,563 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 115, total: 447, max: 672
2014-04-09 19:34:12,563 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 66% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:34:12,563 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 5, with threshold: 2
2014-04-09 19:34:12,563 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 115, total: 447, max: 672
2014-04-09 19:34:12,563 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 66% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:34:12,564 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 7, with threshold: 2
2014-04-09 19:34:12,564 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 115, total: 447, max: 672
2014-04-09 19:34:12,564 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 66% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:34:12,564 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:34:12,565 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:34:12,566 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0024_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:34:15,544 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:34:15,545 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0024_m_000000_0' done.
2014-04-09 19:34:15,548 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@f769e71
2014-04-09 19:34:15,548 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:34:15,549 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 19:34:15,549 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 452 bytes
2014-04-09 19:34:15,549 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:34:15,550 INFO  hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:34:15,550 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:34:15,554 INFO  hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(name)[by:[{1}:'char']]
2014-04-09 19:34:15,554 INFO  hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average', 'average2', 'first']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/multi"]
2014-04-09 19:34:15,557 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0024_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:34:15,557 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:34:15,558 INFO  mapred.Task (Task.java:commit(1000)) - Task attempt_local_0024_r_000000_0 is allowed to commit now
2014-04-09 19:34:15,558 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0024_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/multi
2014-04-09 19:34:18,548 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:34:18,549 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0024_r_000000_0' done.
2014-04-09 19:34:18,552 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/multi/_temporary
2014-04-09 19:34:18,560 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:18,569 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:18,569 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/multi
2014-04-09 19:34:18,573 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:34:18,574 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:34:18,579 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [shape] starting
2014-04-09 19:34:18,579 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [shape]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt"]
2014-04-09 19:34:18,579 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [shape]  sink: Hfs["TextLine[['num']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/retainnarrow"]
2014-04-09 19:34:18,579 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [shape]  parallel execution is enabled: false
2014-04-09 19:34:18,579 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [shape]  starting jobs: 1
2014-04-09 19:34:18,579 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [shape]  allocating threads: 1
2014-04-09 19:34:18,580 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] starting step: (1/1) ...persplatform/retainnarrow
2014-04-09 19:34:18,583 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:18,591 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] submitted hadoop job: job_local_0025
2014-04-09 19:34:18,591 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] tracking url: http://localhost:8080/
2014-04-09 19:34:18,592 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@68ac8a06
2014-04-09 19:34:18,592 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt
2014-04-09 19:34:18,593 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 0
2014-04-09 19:34:18,594 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:34:18,594 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:34:18,596 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt"]
2014-04-09 19:34:18,596 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: Hfs["TextLine[['num']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/retainnarrow"]
2014-04-09 19:34:18,597 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0025_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:34:18,598 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:34:18,598 INFO  mapred.Task (Task.java:commit(1000)) - Task attempt_local_0025_m_000000_0 is allowed to commit now
2014-04-09 19:34:18,599 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0025_m_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/retainnarrow
2014-04-09 19:34:21,592 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt:0+19
2014-04-09 19:34:21,593 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0025_m_000000_0' done.
2014-04-09 19:34:21,596 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/retainnarrow/_temporary
2014-04-09 19:34:21,605 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:21,607 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/retainnarrow
2014-04-09 19:34:21,616 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:34:21,616 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:34:21,622 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [shape] starting
2014-04-09 19:34:21,622 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [shape]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt"]
2014-04-09 19:34:21,622 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [shape]  sink: Hfs["TextLine[['item']->['char', 'item']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/renamenarrow"]
2014-04-09 19:34:21,623 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [shape]  parallel execution is enabled: false
2014-04-09 19:34:21,623 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [shape]  starting jobs: 1
2014-04-09 19:34:21,623 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [shape]  allocating threads: 1
2014-04-09 19:34:21,624 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] starting step: (1/1) ...persplatform/renamenarrow
2014-04-09 19:34:21,629 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:21,637 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] submitted hadoop job: job_local_0026
2014-04-09 19:34:21,637 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] tracking url: http://localhost:8080/
2014-04-09 19:34:21,639 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@49740540
2014-04-09 19:34:21,640 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt
2014-04-09 19:34:21,641 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 0
2014-04-09 19:34:21,643 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:34:21,643 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:34:21,648 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt"]
2014-04-09 19:34:21,648 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: Hfs["TextLine[['item']->['char', 'item']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/renamenarrow"]
2014-04-09 19:34:21,649 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0026_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:34:21,649 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:34:21,650 INFO  mapred.Task (Task.java:commit(1000)) - Task attempt_local_0026_m_000000_0 is allowed to commit now
2014-04-09 19:34:21,651 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0026_m_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/renamenarrow
2014-04-09 19:34:24,639 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt:0+19
2014-04-09 19:34:24,640 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0026_m_000000_0' done.
2014-04-09 19:34:24,643 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/renamenarrow/_temporary
2014-04-09 19:34:24,651 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:24,653 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/renamenarrow
2014-04-09 19:34:24,660 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:34:24,660 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:34:24,667 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [average] starting
2014-04-09 19:34:24,667 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [average]  source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:34:24,668 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [average]  sink: Hfs["TextDelimited[['char', 'average']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/averagenull"]
2014-04-09 19:34:24,668 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [average]  parallel execution is enabled: false
2014-04-09 19:34:24,668 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [average]  starting jobs: 1
2014-04-09 19:34:24,668 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [average]  allocating threads: 1
2014-04-09 19:34:24,668 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [average] starting step: (1/1) ...lpersplatform/averagenull
2014-04-09 19:34:24,675 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:24,685 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [average] submitted hadoop job: job_local_0027
2014-04-09 19:34:24,685 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [average] tracking url: http://localhost:8080/
2014-04-09 19:34:24,687 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@6a8fa261
2014-04-09 19:34:24,688 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:34:24,689 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:34:24,689 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:34:24,699 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:34:24,699 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:34:24,700 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:34:24,700 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:34:24,704 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:34:24,704 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(average)[by:[{1}:'char']]
2014-04-09 19:34:24,704 INFO  assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:34:24,706 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:34:24,706 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 79, total: 542, max: 672
2014-04-09 19:34:24,706 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:34:24,706 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 79, total: 542, max: 672
2014-04-09 19:34:24,707 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 5, with threshold: 2
2014-04-09 19:34:24,707 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 79, total: 542, max: 672
2014-04-09 19:34:24,707 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 7, with threshold: 2
2014-04-09 19:34:24,707 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 79, total: 542, max: 672
2014-04-09 19:34:24,707 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:34:24,708 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:34:24,709 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0027_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:34:27,687 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:34:27,688 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0027_m_000000_0' done.
2014-04-09 19:34:27,690 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@59aa724f
2014-04-09 19:34:27,690 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:34:27,690 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 19:34:27,690 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 200 bytes
2014-04-09 19:34:27,690 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:34:27,691 INFO  hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:34:27,691 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:34:27,694 INFO  hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(average)[by:[{1}:'char']]
2014-04-09 19:34:27,694 INFO  hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextDelimited[['char', 'average']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/averagenull"]
2014-04-09 19:34:27,696 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0027_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:34:27,697 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:34:27,697 INFO  mapred.Task (Task.java:commit(1000)) - Task attempt_local_0027_r_000000_0 is allowed to commit now
2014-04-09 19:34:27,698 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0027_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/averagenull
2014-04-09 19:34:30,690 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:34:30,691 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0027_r_000000_0' done.
2014-04-09 19:34:30,695 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/averagenull/_temporary
2014-04-09 19:34:30,703 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:30,710 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:30,710 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/averagenull
2014-04-09 19:34:30,714 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:34:30,714 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:34:30,719 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [coerce] starting
2014-04-09 19:34:30,720 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [coerce]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt"]
2014-04-09 19:34:30,720 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [coerce]  sink: Hfs["TextLine[['line']->['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/coerce"]
2014-04-09 19:34:30,720 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [coerce]  parallel execution is enabled: false
2014-04-09 19:34:30,720 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [coerce]  starting jobs: 1
2014-04-09 19:34:30,720 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [coerce]  allocating threads: 1
2014-04-09 19:34:30,721 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [coerce] starting step: (1/1) ...blyhelpersplatform/coerce
2014-04-09 19:34:30,727 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:30,737 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [coerce] submitted hadoop job: job_local_0028
2014-04-09 19:34:30,737 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [coerce] tracking url: http://localhost:8080/
2014-04-09 19:34:30,739 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@708ed3b
2014-04-09 19:34:30,740 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt
2014-04-09 19:34:30,740 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 0
2014-04-09 19:34:30,741 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:34:30,741 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:34:30,743 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt"]
2014-04-09 19:34:30,743 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: Hfs["TextLine[['line']->['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/coerce"]
2014-04-09 19:34:30,744 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0028_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:34:30,744 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:34:30,744 INFO  mapred.Task (Task.java:commit(1000)) - Task attempt_local_0028_m_000000_0 is allowed to commit now
2014-04-09 19:34:30,745 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0028_m_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/coerce
2014-04-09 19:34:33,739 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt:0+19
2014-04-09 19:34:33,740 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0028_m_000000_0' done.
2014-04-09 19:34:33,742 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/coerce/_temporary
2014-04-09 19:34:33,751 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:33,752 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/coerce
2014-04-09 19:34:33,761 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:34:33,761 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:34:33,789 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [count-lhs*source*count...] starting
2014-04-09 19:34:33,790 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [count-lhs*source*count...]  source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:34:33,790 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [count-lhs*source*count...]  sink: Hfs["TextDelimited[['char', 'count']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/samesourcemergethreeway"]
2014-04-09 19:34:33,790 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [count-lhs*source*count...]  parallel execution is enabled: false
2014-04-09 19:34:33,790 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [count-lhs*source*count...]  starting jobs: 5
2014-04-09 19:34:33,790 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [count-lhs*source*count...]  allocating threads: 1
2014-04-09 19:34:33,791 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] starting step: (1/5)
2014-04-09 19:34:33,797 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:33,805 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] submitted hadoop job: job_local_0029
2014-04-09 19:34:33,806 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2014-04-09 19:34:33,806 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@724d543f
2014-04-09 19:34:33,811 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:34:33,812 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:34:33,812 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:34:33,823 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:34:33,823 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:34:33,824 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:34:33,824 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:34:33,827 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:34:33,828 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(source)[by:[{1}:'char']]
2014-04-09 19:34:33,828 INFO  assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:34:33,828 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:34:33,828 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 81, total: 576, max: 672
2014-04-09 19:34:33,829 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:34:33,829 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 81, total: 576, max: 672
2014-04-09 19:34:33,829 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 5, with threshold: 2
2014-04-09 19:34:33,829 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 81, total: 576, max: 672
2014-04-09 19:34:33,829 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 7, with threshold: 2
2014-04-09 19:34:33,829 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 81, total: 576, max: 672
2014-04-09 19:34:33,830 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:34:33,831 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:34:33,831 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0029_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:34:36,807 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:34:36,808 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0029_m_000000_0' done.
2014-04-09 19:34:36,809 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@6ff28e4d
2014-04-09 19:34:36,809 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:34:36,810 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 19:34:36,810 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 119 bytes
2014-04-09 19:34:36,810 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:34:36,811 INFO  hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:34:36,811 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:34:36,813 INFO  hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(source)[by:[{1}:'char']]
2014-04-09 19:34:36,814 INFO  hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: TempHfs["SequenceFile[['char', 'count']]"][1118294604/source/]
2014-04-09 19:34:36,815 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0029_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:34:36,816 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:34:36,816 INFO  mapred.Task (Task.java:commit(1000)) - Task attempt_local_0029_r_000000_0 is allowed to commit now
2014-04-09 19:34:36,816 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0029_r_000000_0' to file:/tmp/hadoop-brock/1118294604_source_A37DC37CFA2545A08FDED273325894B3
2014-04-09 19:34:39,809 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:34:39,810 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0029_r_000000_0' done.
2014-04-09 19:34:39,814 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] starting step: (3/5)
2014-04-09 19:34:39,820 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:39,827 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] submitted hadoop job: job_local_0030
2014-04-09 19:34:39,827 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2014-04-09 19:34:39,829 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@3aa80ebe
2014-04-09 19:34:39,830 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-brock/1118294604_source_A37DC37CFA2545A08FDED273325894B3/part-00000
2014-04-09 19:34:39,831 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:34:39,831 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:34:39,844 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:34:39,844 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:34:39,845 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:34:39,845 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:34:39,848 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][1118294604/source/]
2014-04-09 19:34:39,848 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(count-lhs)[by:[{1}:'char']]
2014-04-09 19:34:39,848 INFO  assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:34:39,849 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:34:39,849 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 46, total: 648, max: 672
2014-04-09 19:34:39,849 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:34:39,849 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 46, total: 648, max: 672
2014-04-09 19:34:39,849 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:34:39,850 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:34:39,851 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0030_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:34:42,829 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/tmp/hadoop-brock/1118294604_source_A37DC37CFA2545A08FDED273325894B3/part-00000:0+160
2014-04-09 19:34:42,830 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0030_m_000000_0' done.
2014-04-09 19:34:42,833 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@639adf08
2014-04-09 19:34:42,833 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:34:42,834 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 19:34:42,835 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 67 bytes
2014-04-09 19:34:42,835 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:34:42,836 INFO  hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:34:42,836 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:34:42,840 INFO  hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(count-lhs)[by:[{1}:'char']]
2014-04-09 19:34:42,840 INFO  hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: TempHfs["SequenceFile[['char', 'count']]"][4928088765/count-lhs/]
2014-04-09 19:34:42,842 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0030_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:34:42,842 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:34:42,843 INFO  mapred.Task (Task.java:commit(1000)) - Task attempt_local_0030_r_000000_0 is allowed to commit now
2014-04-09 19:34:42,843 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0030_r_000000_0' to file:/tmp/hadoop-brock/4928088765_count_lhs_CD4DA9329239427D9037FBBC6F4B46F8
2014-04-09 19:34:45,833 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:34:45,834 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0030_r_000000_0' done.
2014-04-09 19:34:45,836 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] starting step: (4/5)
2014-04-09 19:34:45,841 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:45,848 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] submitted hadoop job: job_local_0031
2014-04-09 19:34:45,849 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2014-04-09 19:34:45,850 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@40ac12e6
2014-04-09 19:34:45,851 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-brock/1118294604_source_A37DC37CFA2545A08FDED273325894B3/part-00000
2014-04-09 19:34:45,852 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:34:45,853 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:34:45,868 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:34:45,868 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:34:45,869 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:34:45,869 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:34:45,872 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][1118294604/source/]
2014-04-09 19:34:45,872 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(count-rhs)[by:[{1}:'char']]
2014-04-09 19:34:45,872 INFO  assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:34:45,872 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:34:45,873 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 80, total: 667, max: 672
2014-04-09 19:34:45,873 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:34:45,873 INFO  assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 80, total: 667, max: 672
2014-04-09 19:34:45,873 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:34:45,874 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:34:45,874 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0031_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:34:48,851 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/tmp/hadoop-brock/1118294604_source_A37DC37CFA2545A08FDED273325894B3/part-00000:0+160
2014-04-09 19:34:48,851 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0031_m_000000_0' done.
2014-04-09 19:34:48,854 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@453180f7
2014-04-09 19:34:48,854 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:34:48,855 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 19:34:48,856 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 67 bytes
2014-04-09 19:34:48,856 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:34:48,857 INFO  hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:34:48,857 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:34:48,860 INFO  hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(count-rhs)[by:[{1}:'char']]
2014-04-09 19:34:48,860 INFO  hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: TempHfs["SequenceFile[['char', 'count']]"][2414826741/count-rhs/]
2014-04-09 19:34:48,862 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0031_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:34:48,862 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:34:48,862 INFO  mapred.Task (Task.java:commit(1000)) - Task attempt_local_0031_r_000000_0 is allowed to commit now
2014-04-09 19:34:48,863 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0031_r_000000_0' to file:/tmp/hadoop-brock/2414826741_count_rhs_2E8A78AB7CFA4D7FB534F2D024220D22
2014-04-09 19:34:51,854 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:34:51,855 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0031_r_000000_0' done.
2014-04-09 19:34:51,867 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] starting step: (2/5)
2014-04-09 19:34:51,871 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:51,871 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:51,878 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] submitted hadoop job: job_local_0032
2014-04-09 19:34:51,878 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2014-04-09 19:34:51,881 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@906b39f
2014-04-09 19:34:51,882 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-brock/1118294604_source_A37DC37CFA2545A08FDED273325894B3/part-00000
2014-04-09 19:34:51,884 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:34:51,884 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:34:51,903 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:34:51,903 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:34:51,904 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:34:51,905 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:34:51,910 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][1118294604/source/]
2014-04-09 19:34:51,910 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: CoGroup(source*count-rhs)[by: source:[{1}:'char'] count-rhs:[{1}:'char']]
2014-04-09 19:34:51,911 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:34:51,911 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:34:51,912 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0032_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:34:54,881 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/tmp/hadoop-brock/1118294604_source_A37DC37CFA2545A08FDED273325894B3/part-00000:0+160
2014-04-09 19:34:54,882 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0032_m_000000_0' done.
2014-04-09 19:34:54,884 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@3c098b
2014-04-09 19:34:54,885 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-brock/2414826741_count_rhs_2E8A78AB7CFA4D7FB534F2D024220D22/part-00000
2014-04-09 19:34:54,886 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:34:54,886 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:34:54,901 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:34:54,901 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:34:54,902 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:34:54,902 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:34:54,905 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][2414826741/count-rhs/]
2014-04-09 19:34:54,905 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: CoGroup(source*count-rhs)[by: source:[{1}:'char'] count-rhs:[{1}:'char']]
2014-04-09 19:34:54,906 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:34:54,906 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:34:54,907 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0032_m_000001_0 is done. And is in the process of commiting
2014-04-09 19:34:57,884 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/tmp/hadoop-brock/2414826741_count_rhs_2E8A78AB7CFA4D7FB534F2D024220D22/part-00000:0+160
2014-04-09 19:34:57,885 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0032_m_000001_0' done.
2014-04-09 19:34:57,888 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@1c9a8519
2014-04-09 19:34:57,888 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:34:57,889 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 2 sorted segments
2014-04-09 19:34:57,889 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 2 segments left of total size: 154 bytes
2014-04-09 19:34:57,889 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:34:57,890 INFO  hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:34:57,890 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:34:57,893 INFO  hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: CoGroup(source*count-rhs)[by: source:[{1}:'char'] count-rhs:[{1}:'char']]
2014-04-09 19:34:57,893 INFO  hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: TempHfs["SequenceFile[['char', 'num', 'char2', 'count']]"][5990140638/source_count-rhs/]
2014-04-09 19:34:57,896 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2014-04-09 19:34:57,897 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2014-04-09 19:34:57,899 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0032_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:34:57,899 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:34:57,900 INFO  mapred.Task (Task.java:commit(1000)) - Task attempt_local_0032_r_000000_0 is allowed to commit now
2014-04-09 19:34:57,900 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0032_r_000000_0' to file:/tmp/hadoop-brock/5990140638_source_count_rhs_F15FE30E40544D34A04BEECA63DBC72F
2014-04-09 19:35:00,888 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:35:00,889 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0032_r_000000_0' done.
2014-04-09 19:35:00,899 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] starting step: (5/5) ...m/samesourcemergethreeway
2014-04-09 19:35:00,905 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:35:00,906 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:35:00,914 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] submitted hadoop job: job_local_0033
2014-04-09 19:35:00,915 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2014-04-09 19:35:00,917 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@1591c3ce
2014-04-09 19:35:00,918 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-brock/5990140638_source_count_rhs_F15FE30E40544D34A04BEECA63DBC72F/part-00000
2014-04-09 19:35:00,918 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:35:00,919 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:35:00,933 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:35:00,933 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:35:00,934 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:35:00,934 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:35:00,938 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: TempHfs["SequenceFile[['char', 'num', 'char2', 'count']]"][5990140638/source_count-rhs/]
2014-04-09 19:35:00,939 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: CoGroup(count-lhs*source*count-rhs)[by: count-lhs:[{1}:'char'] source*count-rhs:[{1}:'char']]
2014-04-09 19:35:00,940 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:35:00,940 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:35:00,941 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0033_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:35:03,917 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/tmp/hadoop-brock/5990140638_source_count_rhs_F15FE30E40544D34A04BEECA63DBC72F/part-00000:0+200
2014-04-09 19:35:03,918 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0033_m_000000_0' done.
2014-04-09 19:35:03,919 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@161fd466
2014-04-09 19:35:03,919 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-brock/4928088765_count_lhs_CD4DA9329239427D9037FBBC6F4B46F8/part-00000
2014-04-09 19:35:03,920 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:35:03,921 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:35:03,931 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:35:03,931 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:35:03,932 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:35:03,932 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:35:03,936 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][4928088765/count-lhs/]
2014-04-09 19:35:03,936 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: CoGroup(count-lhs*source*count-rhs)[by: count-lhs:[{1}:'char'] source*count-rhs:[{1}:'char']]
2014-04-09 19:35:03,937 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:35:03,937 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:35:03,938 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0033_m_000001_0 is done. And is in the process of commiting
2014-04-09 19:35:06,919 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/tmp/hadoop-brock/4928088765_count_lhs_CD4DA9329239427D9037FBBC6F4B46F8/part-00000:0+160
2014-04-09 19:35:06,920 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0033_m_000001_0' done.
2014-04-09 19:35:06,924 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@66c0046
2014-04-09 19:35:06,925 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:35:06,926 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 2 sorted segments
2014-04-09 19:35:06,926 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 2 segments left of total size: 194 bytes
2014-04-09 19:35:06,926 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:35:06,927 INFO  hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:35:06,927 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:35:06,931 INFO  hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: CoGroup(count-lhs*source*count-rhs)[by: count-lhs:[{1}:'char'] source*count-rhs:[{1}:'char']]
2014-04-09 19:35:06,931 INFO  hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextDelimited[['char', 'count']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/samesourcemergethreeway"]
2014-04-09 19:35:06,932 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2014-04-09 19:35:06,932 INFO  collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2014-04-09 19:35:06,933 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0033_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:35:06,934 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:35:06,934 INFO  mapred.Task (Task.java:commit(1000)) - Task attempt_local_0033_r_000000_0 is allowed to commit now
2014-04-09 19:35:06,935 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0033_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/samesourcemergethreeway
2014-04-09 19:35:09,924 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:35:09,925 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0033_r_000000_0' done.
2014-04-09 19:35:09,937 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/samesourcemergethreeway/_temporary
2014-04-09 19:35:09,946 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:35:09,954 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:35:09,956 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/samesourcemergethreeway
2014-04-09 19:35:09,962 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:35:09,962 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:35:09,971 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [lhs+rhs] starting
2014-04-09 19:35:09,971 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [lhs+rhs]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt"]
2014-04-09 19:35:09,971 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [lhs+rhs]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:35:09,971 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [lhs+rhs]  sink: Hfs["TextLine[['item']->['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/uniquemerge-nondeterministic"]
2014-04-09 19:35:09,971 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [lhs+rhs]  parallel execution is enabled: false
2014-04-09 19:35:09,972 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [lhs+rhs]  starting jobs: 1
2014-04-09 19:35:09,972 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [lhs+rhs]  allocating threads: 1
2014-04-09 19:35:09,972 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs+rhs] starting step: (1/1) ...quemerge-nondeterministic
2014-04-09 19:35:09,979 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:35:09,979 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:35:09,986 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs+rhs] submitted hadoop job: job_local_0034
2014-04-09 19:35:09,986 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs+rhs] tracking url: http://localhost:8080/
2014-04-09 19:35:09,988 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@4c058333
2014-04-09 19:35:09,989 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:35:09,989 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:35:09,989 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:35:10,004 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:35:10,004 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:35:10,005 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:35:10,005 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:35:10,008 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:35:10,008 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(lhs+rhs)[by: lhs:[{1}:'num'] rhs:[{1}:'num']]
2014-04-09 19:35:10,010 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:35:10,010 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:35:10,011 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0034_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:35:12,989 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:35:12,990 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0034_m_000000_0' done.
2014-04-09 19:35:12,991 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@4666d804
2014-04-09 19:35:12,992 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt
2014-04-09 19:35:12,993 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:35:12,993 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:35:13,005 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:35:13,005 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:35:13,006 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:35:13,006 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:35:13,009 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt"]
2014-04-09 19:35:13,009 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(lhs+rhs)[by: lhs:[{1}:'num'] rhs:[{1}:'num']]
2014-04-09 19:35:13,010 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:35:13,010 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:35:13,011 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0034_m_000001_0 is done. And is in the process of commiting
2014-04-09 19:35:15,991 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt:0+51
2014-04-09 19:35:15,992 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0034_m_000001_0' done.
2014-04-09 19:35:15,996 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@43169d2e
2014-04-09 19:35:15,997 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:35:15,998 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 2 sorted segments
2014-04-09 19:35:15,998 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 2 segments left of total size: 174 bytes
2014-04-09 19:35:15,998 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:35:15,999 INFO  hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:35:15,999 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:35:16,001 INFO  hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(lhs+rhs)[by: lhs:[{1}:'num'] rhs:[{1}:'num']]
2014-04-09 19:35:16,001 INFO  hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextLine[['item']->['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/uniquemerge-nondeterministic"]
2014-04-09 19:35:16,004 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0034_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:35:16,004 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:35:16,004 INFO  mapred.Task (Task.java:commit(1000)) - Task attempt_local_0034_r_000000_0 is allowed to commit now
2014-04-09 19:35:16,005 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0034_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/uniquemerge-nondeterministic
2014-04-09 19:35:18,996 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:35:18,997 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0034_r_000000_0' done.
2014-04-09 19:35:19,007 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/uniquemerge-nondeterministic/_temporary
2014-04-09 19:35:19,011 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:35:19,012 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/uniquemerge-nondeterministic
2014-04-09 19:35:19,018 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:35:19,018 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:35:19,029 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [shape] starting
2014-04-09 19:35:19,029 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [shape]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:35:19,030 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [shape]  sink: Hfs["TextLine[['item']->['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/unique"]
2014-04-09 19:35:19,030 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [shape]  parallel execution is enabled: false
2014-04-09 19:35:19,030 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [shape]  starting jobs: 1
2014-04-09 19:35:19,030 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [shape]  allocating threads: 1
2014-04-09 19:35:19,031 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] starting step: (1/1) ...blyhelpersplatform/unique
2014-04-09 19:35:19,037 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:35:19,045 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] submitted hadoop job: job_local_0035
2014-04-09 19:35:19,045 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] tracking url: http://localhost:8080/
2014-04-09 19:35:19,047 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@6f9a60c6
2014-04-09 19:35:19,047 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:35:19,048 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:35:19,048 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:35:19,063 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:35:19,063 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:35:19,064 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:35:19,064 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:35:19,066 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:35:19,066 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(shape)[by:[{1}:'num']]
2014-04-09 19:35:19,068 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:35:19,068 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:35:19,069 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0035_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:35:22,047 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:35:22,048 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0035_m_000000_0' done.
2014-04-09 19:35:22,049 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@1bc0b22b
2014-04-09 19:35:22,049 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:35:22,050 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 19:35:22,050 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 87 bytes
2014-04-09 19:35:22,050 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:35:22,051 INFO  hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:35:22,051 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:35:22,053 INFO  hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(shape)[by:[{1}:'num']]
2014-04-09 19:35:22,053 INFO  hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextLine[['item']->['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/unique"]
2014-04-09 19:35:22,054 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0035_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:35:22,054 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:35:22,055 INFO  mapred.Task (Task.java:commit(1000)) - Task attempt_local_0035_r_000000_0 is allowed to commit now
2014-04-09 19:35:22,055 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0035_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/unique
2014-04-09 19:35:25,049 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:35:25,050 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0035_r_000000_0' done.
2014-04-09 19:35:25,062 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/unique/_temporary
2014-04-09 19:35:25,069 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:35:25,069 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/unique
2014-04-09 19:35:25,076 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:35:25,076 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:35:25,083 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [count] starting
2014-04-09 19:35:25,083 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [count]  source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:35:25,084 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [count]  sink: Hfs["TextDelimited[['notnull', 'null']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/countnullnotnull"]
2014-04-09 19:35:25,084 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [count]  parallel execution is enabled: false
2014-04-09 19:35:25,084 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [count]  starting jobs: 1
2014-04-09 19:35:25,084 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [count]  allocating threads: 1
2014-04-09 19:35:25,084 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] starting step: (1/1) ...platform/countnullnotnull
2014-04-09 19:35:25,087 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:35:25,094 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] submitted hadoop job: job_local_0036
2014-04-09 19:35:25,094 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] tracking url: http://localhost:8080/
2014-04-09 19:35:25,096 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@36df9dd7
2014-04-09 19:35:25,097 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:35:25,098 INFO  mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:35:25,099 INFO  mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:35:25,112 INFO  mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:35:25,112 INFO  mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:35:25,113 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:35:25,113 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:35:25,116 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:35:25,116 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(count)[by:[{?}:NONE]]
2014-04-09 19:35:25,116 INFO  assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:35:25,119 INFO  mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:35:25,119 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:35:25,120 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0036_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:35:28,097 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:35:28,097 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0036_m_000000_0' done.
2014-04-09 19:35:28,100 INFO  mapred.Task (Task.java:initialize(534)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@2179e0ae
2014-04-09 19:35:28,100 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:35:28,100 INFO  mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 19:35:28,100 INFO  mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 10 bytes
2014-04-09 19:35:28,100 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:35:28,101 INFO  hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:35:28,101 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:35:28,104 INFO  hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(count)[by:[{?}:NONE]]
2014-04-09 19:35:28,104 INFO  hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextDelimited[['notnull', 'null']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/countnullnotnull"]
2014-04-09 19:35:28,105 INFO  mapred.Task (Task.java:done(847)) - Task:attempt_local_0036_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:35:28,106 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - 
2014-04-09 19:35:28,106 INFO  mapred.Task (Task.java:commit(1000)) - Task attempt_local_0036_r_000000_0 is allowed to commit now
2014-04-09 19:35:28,107 INFO  mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0036_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/countnullnotnull
2014-04-09 19:35:31,100 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:35:31,101 INFO  mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0036_r_000000_0' done.
2014-04-09 19:35:31,105 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/countnullnotnull/_temporary
2014-04-09 19:35:31,113 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:35:31,121 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:35:31,122 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/countnullnotnull