2014-04-09 19:31:49,281 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(187)) - found 1 test platforms from classpath
2014-04-09 19:31:49,299 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(237)) - installing platform: hadoop
2014-04-09 19:31:49,299 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(238)) - running test: cascading.pipe.assembly.AssemblyHelpersPlatformTest
2014-04-09 19:31:49,314 INFO hadoop.HadoopPlatform (HadoopPlatform.java:setUp(112)) - not using cluster
2014-04-09 19:31:49,592 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:31:49,592 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:31:49,598 INFO property.AppProps (AppProps.java:getAppID(162)) - using app.id: E32D0AD0514F47E597A04C119B6EE0E1
2014-04-09 19:31:49,719 INFO util.Version (Version.java:printBanner(78)) - Concurrent, Inc - Cascading 2.5.3
2014-04-09 19:31:49,721 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [name] starting
2014-04-09 19:31:49,721 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt"]
2014-04-09 19:31:49,721 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:31:49,722 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [name] sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/multimerge+false"]
2014-04-09 19:31:49,722 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [name] parallel execution is enabled: false
2014-04-09 19:31:49,722 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [name] starting jobs: 1
2014-04-09 19:31:49,722 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [name] allocating threads: 1
2014-04-09 19:31:49,723 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [name] starting step: (1/1) ...platform/multimerge+false
2014-04-09 19:31:49,744 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(52)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2014-04-09 19:31:49,764 WARN snappy.LoadSnappy (LoadSnappy.java:<clinit>(46)) - Snappy native library not loaded
2014-04-09 19:31:49,766 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:31:49,770 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:31:49,861 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [name] submitted hadoop job: job_local_0001
2014-04-09 19:31:49,862 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [name] tracking url: http://localhost:8080/
2014-04-09 19:31:49,889 INFO util.ProcessTree (ProcessTree.java:isSetsidSupported(63)) - setsid exited with exit code 0
2014-04-09 19:31:49,891 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@29ab993
2014-04-09 19:31:49,894 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:31:49,897 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:31:49,900 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:31:49,909 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:31:49,910 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:31:49,919 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:31:49,919 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:31:49,949 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:31:49,950 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2014-04-09 19:31:49,951 INFO assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:31:49,956 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:31:49,956 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 283, total: 480, max: 672
2014-04-09 19:31:49,956 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:31:49,957 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:31:49,957 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 283, total: 480, max: 672
2014-04-09 19:31:49,957 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:31:49,958 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 5, with threshold: 2
2014-04-09 19:31:49,958 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 283, total: 480, max: 672
2014-04-09 19:31:49,958 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:31:49,958 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 7, with threshold: 2
2014-04-09 19:31:49,959 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 283, total: 480, max: 672
2014-04-09 19:31:49,959 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:31:49,959 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:31:49,964 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:31:49,967 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0001_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:31:52,884 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:31:52,885 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0001_m_000000_0' done.
2014-04-09 19:31:52,888 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@13c03044
2014-04-09 19:31:52,889 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt
2014-04-09 19:31:52,889 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:31:52,890 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:31:52,899 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:31:52,899 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:31:52,900 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:31:52,900 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:31:52,913 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt"]
2014-04-09 19:31:52,913 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2014-04-09 19:31:52,914 INFO assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:31:52,964 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:31:52,964 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 178, total: 480, max: 672
2014-04-09 19:31:52,964 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:31:52,965 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:31:52,965 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 178, total: 480, max: 672
2014-04-09 19:31:52,965 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:31:52,966 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 5, with threshold: 2
2014-04-09 19:31:52,966 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 178, total: 480, max: 672
2014-04-09 19:31:52,966 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:31:52,967 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 7, with threshold: 2
2014-04-09 19:31:52,967 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 178, total: 480, max: 672
2014-04-09 19:31:52,967 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:31:52,968 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:31:52,969 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:31:52,970 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0001_m_000001_0 is done. And is in the process of commiting
2014-04-09 19:31:55,888 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt:0+51
2014-04-09 19:31:55,889 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0001_m_000001_0' done.
2014-04-09 19:31:55,900 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@2366618
2014-04-09 19:31:55,900 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:31:55,903 INFO mapred.Merger (Merger.java:merge(390)) - Merging 2 sorted segments
2014-04-09 19:31:55,905 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 2 segments left of total size: 472 bytes
2014-04-09 19:31:55,905 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:31:55,905 INFO hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:31:55,906 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:31:55,918 INFO hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2014-04-09 19:31:55,918 INFO hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/multimerge+false"]
2014-04-09 19:31:55,928 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0001_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:31:55,929 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:31:55,929 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0001_r_000000_0 is allowed to commit now
2014-04-09 19:31:55,931 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0001_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/multimerge+false
2014-04-09 19:31:58,900 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:31:58,902 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0001_r_000000_0' done.
2014-04-09 19:31:58,915 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/multimerge+false/_temporary
2014-04-09 19:31:58,936 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:31:58,948 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:31:58,950 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/multimerge+false
2014-04-09 19:31:58,965 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:31:58,965 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:31:58,982 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [max] starting
2014-04-09 19:31:58,983 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [max] source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:31:58,983 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [max] sink: Hfs["TextDelimited[['num', 'min']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/minbystring"]
2014-04-09 19:31:58,983 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [max] parallel execution is enabled: false
2014-04-09 19:31:58,983 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [max] starting jobs: 1
2014-04-09 19:31:58,983 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [max] allocating threads: 1
2014-04-09 19:31:58,995 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [max] starting step: (1/1) ...lpersplatform/minbystring
2014-04-09 19:31:59,004 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:31:59,059 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [max] submitted hadoop job: job_local_0002
2014-04-09 19:31:59,059 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [max] tracking url: http://localhost:8080/
2014-04-09 19:31:59,061 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@45d68783
2014-04-09 19:31:59,062 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:31:59,063 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:31:59,064 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:31:59,075 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:31:59,075 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:31:59,076 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:31:59,076 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:31:59,082 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:31:59,082 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(max)[by:[{1}:'num']]
2014-04-09 19:31:59,083 INFO assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:31:59,084 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:31:59,084 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 164, total: 480, max: 672
2014-04-09 19:31:59,084 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:31:59,084 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:31:59,084 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 164, total: 480, max: 672
2014-04-09 19:31:59,085 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:31:59,085 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:31:59,086 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:31:59,088 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0002_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:32:02,062 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:32:02,063 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0002_m_000000_0' done.
2014-04-09 19:32:02,068 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@38bb633e
2014-04-09 19:32:02,068 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:32:02,069 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 19:32:02,069 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 87 bytes
2014-04-09 19:32:02,069 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:32:02,070 INFO hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:32:02,070 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:32:02,076 INFO hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(max)[by:[{1}:'num']]
2014-04-09 19:32:02,077 INFO hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextDelimited[['num', 'min']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/minbystring"]
2014-04-09 19:32:02,080 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0002_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:32:02,081 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:32:02,081 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0002_r_000000_0 is allowed to commit now
2014-04-09 19:32:02,083 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0002_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/minbystring
2014-04-09 19:32:05,068 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:32:05,069 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0002_r_000000_0' done.
2014-04-09 19:32:05,076 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/minbystring/_temporary
2014-04-09 19:32:05,093 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:05,102 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:05,103 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/minbystring
2014-04-09 19:32:05,115 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:32:05,115 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:32:05,137 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [average-lhs+average-rhs] starting
2014-04-09 19:32:05,137 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [average-lhs+average-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt"]
2014-04-09 19:32:05,138 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [average-lhs+average-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:32:05,138 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [average-lhs+average-rhs] sink: Hfs["TextDelimited[['char', 'average']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/mergeaverage"]
2014-04-09 19:32:05,138 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [average-lhs+average-rhs] parallel execution is enabled: false
2014-04-09 19:32:05,138 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [average-lhs+average-rhs] starting jobs: 1
2014-04-09 19:32:05,138 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [average-lhs+average-rhs] allocating threads: 1
2014-04-09 19:32:05,138 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [average-lhs+average-rhs] starting step: (1/1) ...persplatform/mergeaverage
2014-04-09 19:32:05,148 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:05,149 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:05,188 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [average-lhs+average-rhs] submitted hadoop job: job_local_0003
2014-04-09 19:32:05,188 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [average-lhs+average-rhs] tracking url: http://localhost:8080/
2014-04-09 19:32:05,190 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@39e93afb
2014-04-09 19:32:05,198 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:32:05,199 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:32:05,199 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:32:05,210 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:32:05,210 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:32:05,211 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:32:05,211 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:32:05,219 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:32:05,219 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(average-lhs+average-rhs)[by: average-lhs:[{1}:'char'] average-rhs:[{1}:'char']]
2014-04-09 19:32:05,219 INFO assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:32:05,220 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:32:05,220 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 183, total: 480, max: 672
2014-04-09 19:32:05,220 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:32:05,221 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:32:05,221 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 183, total: 480, max: 672
2014-04-09 19:32:05,221 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:32:05,221 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 5, with threshold: 2
2014-04-09 19:32:05,221 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 183, total: 480, max: 672
2014-04-09 19:32:05,222 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:32:05,222 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 7, with threshold: 2
2014-04-09 19:32:05,222 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 183, total: 480, max: 672
2014-04-09 19:32:05,222 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:32:05,223 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:32:05,224 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:32:05,225 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0003_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:32:08,190 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:32:08,191 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0003_m_000000_0' done.
2014-04-09 19:32:08,194 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@4de44dc8
2014-04-09 19:32:08,195 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt
2014-04-09 19:32:08,196 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:32:08,197 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:32:08,207 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:32:08,207 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:32:08,208 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:32:08,208 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:32:08,216 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt"]
2014-04-09 19:32:08,216 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(average-lhs+average-rhs)[by: average-lhs:[{1}:'char'] average-rhs:[{1}:'char']]
2014-04-09 19:32:08,216 INFO assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:32:08,218 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:32:08,218 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 81, total: 480, max: 672
2014-04-09 19:32:08,218 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:32:08,218 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:32:08,219 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 81, total: 480, max: 672
2014-04-09 19:32:08,219 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:32:08,219 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 5, with threshold: 2
2014-04-09 19:32:08,219 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 81, total: 480, max: 672
2014-04-09 19:32:08,219 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:32:08,220 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 7, with threshold: 2
2014-04-09 19:32:08,220 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 81, total: 480, max: 672
2014-04-09 19:32:08,220 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:32:08,220 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:32:08,221 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:32:08,222 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0003_m_000001_0 is done. And is in the process of commiting
2014-04-09 19:32:11,194 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt:0+51
2014-04-09 19:32:11,195 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0003_m_000001_0' done.
2014-04-09 19:32:11,204 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@2e107190
2014-04-09 19:32:11,204 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:32:11,206 INFO mapred.Merger (Merger.java:merge(390)) - Merging 2 sorted segments
2014-04-09 19:32:11,206 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 2 segments left of total size: 400 bytes
2014-04-09 19:32:11,206 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:32:11,207 INFO hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:32:11,208 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:32:11,214 INFO hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(average-lhs+average-rhs)[by: average-lhs:[{1}:'char'] average-rhs:[{1}:'char']]
2014-04-09 19:32:11,214 INFO hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextDelimited[['char', 'average']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/mergeaverage"]
2014-04-09 19:32:11,218 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0003_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:32:11,218 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:32:11,219 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0003_r_000000_0 is allowed to commit now
2014-04-09 19:32:11,220 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0003_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/mergeaverage
2014-04-09 19:32:14,203 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:32:14,204 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0003_r_000000_0' done.
2014-04-09 19:32:14,218 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/mergeaverage/_temporary
2014-04-09 19:32:14,230 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:14,241 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:14,242 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/mergeaverage
2014-04-09 19:32:14,250 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:32:14,250 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:32:14,263 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [shape] starting
2014-04-09 19:32:14,264 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt"]
2014-04-09 19:32:14,264 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [shape] sink: Hfs["TextLine[['line']->['item', 'element']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/renameall"]
2014-04-09 19:32:14,264 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [shape] parallel execution is enabled: false
2014-04-09 19:32:14,264 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [shape] starting jobs: 1
2014-04-09 19:32:14,264 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [shape] allocating threads: 1
2014-04-09 19:32:14,265 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] starting step: (1/1) ...helpersplatform/renameall
2014-04-09 19:32:14,275 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:14,290 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] submitted hadoop job: job_local_0004
2014-04-09 19:32:14,290 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] tracking url: http://localhost:8080/
2014-04-09 19:32:14,292 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@38b38e49
2014-04-09 19:32:14,293 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt
2014-04-09 19:32:14,294 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 0
2014-04-09 19:32:14,296 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:32:14,296 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:32:14,300 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt"]
2014-04-09 19:32:14,300 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: Hfs["TextLine[['line']->['item', 'element']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/renameall"]
2014-04-09 19:32:14,301 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0004_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:32:14,302 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:32:14,302 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0004_m_000000_0 is allowed to commit now
2014-04-09 19:32:14,304 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0004_m_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/renameall
2014-04-09 19:32:17,292 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt:0+19
2014-04-09 19:32:17,293 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0004_m_000000_0' done.
2014-04-09 19:32:17,298 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/renameall/_temporary
2014-04-09 19:32:17,309 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:17,310 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/renameall
2014-04-09 19:32:17,317 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:32:17,317 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:32:17,348 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [count] starting
2014-04-09 19:32:17,349 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [count] source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:32:17,350 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [count] sink: Hfs["TextDelimited[['count', 'count2']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/countcount"]
2014-04-09 19:32:17,350 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [count] parallel execution is enabled: false
2014-04-09 19:32:17,350 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [count] starting jobs: 2
2014-04-09 19:32:17,350 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [count] allocating threads: 1
2014-04-09 19:32:17,350 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] starting step: (1/2)
2014-04-09 19:32:17,357 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:17,371 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] submitted hadoop job: job_local_0005
2014-04-09 19:32:17,371 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] tracking url: http://localhost:8080/
2014-04-09 19:32:17,374 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@26fc5202
2014-04-09 19:32:17,375 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:32:17,377 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:32:17,377 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:32:17,388 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:32:17,388 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:32:17,389 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:32:17,389 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:32:17,395 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:32:17,395 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(count)[by:[{1}:'char']]
2014-04-09 19:32:17,395 INFO assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:32:17,396 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:32:17,396 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 84, total: 480, max: 672
2014-04-09 19:32:17,396 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:32:17,397 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:32:17,397 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 84, total: 480, max: 672
2014-04-09 19:32:17,397 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:32:17,397 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 5, with threshold: 2
2014-04-09 19:32:17,397 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 84, total: 480, max: 672
2014-04-09 19:32:17,397 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:32:17,398 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 7, with threshold: 2
2014-04-09 19:32:17,398 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 84, total: 480, max: 672
2014-04-09 19:32:17,398 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:32:17,398 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:32:17,399 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:32:17,400 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0005_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:32:20,374 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:32:20,375 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0005_m_000000_0' done.
2014-04-09 19:32:20,380 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@6897f7ca
2014-04-09 19:32:20,380 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:32:20,382 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 19:32:20,382 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 119 bytes
2014-04-09 19:32:20,382 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:32:20,383 INFO hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:32:20,384 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:32:20,391 INFO hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(count)[by:[{1}:'char']]
2014-04-09 19:32:20,392 INFO hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: TempHfs["SequenceFile[['count', 'count2']]"][4223958462/count/]
2014-04-09 19:32:20,396 INFO assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:32:20,397 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:32:20,397 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 80, total: 480, max: 672
2014-04-09 19:32:20,397 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:32:20,398 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0005_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:32:20,398 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:32:20,399 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0005_r_000000_0 is allowed to commit now
2014-04-09 19:32:20,400 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0005_r_000000_0' to file:/tmp/hadoop-brock/4223958462_count_A23BB91DC04047C7955DA5EE5C401B8F
2014-04-09 19:32:23,379 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:32:23,381 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0005_r_000000_0' done.
2014-04-09 19:32:23,384 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] starting step: (2/2) ...elpersplatform/countcount
2014-04-09 19:32:23,393 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:23,414 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] submitted hadoop job: job_local_0006
2014-04-09 19:32:23,414 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] tracking url: http://localhost:8080/
2014-04-09 19:32:23,416 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@71474694
2014-04-09 19:32:23,416 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-brock/4223958462_count_A23BB91DC04047C7955DA5EE5C401B8F/part-00000
2014-04-09 19:32:23,419 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:32:23,420 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:32:23,430 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:32:23,430 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:32:23,431 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:32:23,431 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:32:23,436 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: TempHfs["SequenceFile[['count', 'count2']]"][4223958462/count/]
2014-04-09 19:32:23,436 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(count)[by:[{1}:'count']]
2014-04-09 19:32:23,437 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:32:23,438 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:32:23,439 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0006_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:32:26,416 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/tmp/hadoop-brock/4223958462_count_A23BB91DC04047C7955DA5EE5C401B8F/part-00000:0+112
2014-04-09 19:32:26,417 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0006_m_000000_0' done.
2014-04-09 19:32:26,421 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@10e631f
2014-04-09 19:32:26,422 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:32:26,423 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 19:32:26,423 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 29 bytes
2014-04-09 19:32:26,424 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:32:26,424 INFO hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:32:26,425 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:32:26,432 INFO hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(count)[by:[{1}:'count']]
2014-04-09 19:32:26,432 INFO hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextDelimited[['count', 'count2']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/countcount"]
2014-04-09 19:32:26,434 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0006_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:32:26,435 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:32:26,435 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0006_r_000000_0 is allowed to commit now
2014-04-09 19:32:26,436 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0006_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/countcount
2014-04-09 19:32:29,421 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:32:29,422 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0006_r_000000_0' done.
2014-04-09 19:32:29,429 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/countcount/_temporary
2014-04-09 19:32:29,441 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:29,447 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:29,447 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/countcount
2014-04-09 19:32:29,462 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:32:29,462 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:32:29,479 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [count-lhs+count-rhs] starting
2014-04-09 19:32:29,479 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [count-lhs+count-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt"]
2014-04-09 19:32:29,479 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [count-lhs+count-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:32:29,480 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [count-lhs+count-rhs] sink: Hfs["TextDelimited[['char', 'count']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/mergecount"]
2014-04-09 19:32:29,480 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [count-lhs+count-rhs] parallel execution is enabled: false
2014-04-09 19:32:29,480 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [count-lhs+count-rhs] starting jobs: 1
2014-04-09 19:32:29,480 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [count-lhs+count-rhs] allocating threads: 1
2014-04-09 19:32:29,481 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs+count-rhs] starting step: (1/1) ...elpersplatform/mergecount
2014-04-09 19:32:29,487 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:29,488 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:29,503 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs+count-rhs] submitted hadoop job: job_local_0007
2014-04-09 19:32:29,503 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs+count-rhs] tracking url: http://localhost:8080/
2014-04-09 19:32:29,506 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@14d21a20
2014-04-09 19:32:29,507 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:32:29,509 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:32:29,509 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:32:29,520 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:32:29,520 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:32:29,521 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:32:29,521 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:32:29,527 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:32:29,527 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(count-lhs+count-rhs)[by: count-lhs:[{1}:'char'] count-rhs:[{1}:'char']]
2014-04-09 19:32:29,527 INFO assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:32:29,528 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:32:29,528 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 82, total: 575, max: 672
2014-04-09 19:32:29,528 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:32:29,528 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 82, total: 575, max: 672
2014-04-09 19:32:29,529 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 5, with threshold: 2
2014-04-09 19:32:29,529 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 82, total: 575, max: 672
2014-04-09 19:32:29,529 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 7, with threshold: 2
2014-04-09 19:32:29,529 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 82, total: 575, max: 672
2014-04-09 19:32:29,530 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:32:29,531 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:32:29,532 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0007_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:32:32,506 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:32:32,507 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0007_m_000000_0' done.
2014-04-09 19:32:32,509 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@30b4562b
2014-04-09 19:32:32,509 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt
2014-04-09 19:32:32,510 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:32:32,510 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:32:32,519 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:32:32,520 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:32:32,520 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:32:32,520 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:32:32,527 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt"]
2014-04-09 19:32:32,527 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(count-lhs+count-rhs)[by: count-lhs:[{1}:'char'] count-rhs:[{1}:'char']]
2014-04-09 19:32:32,527 INFO assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:32:32,529 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:32:32,529 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 55, total: 650, max: 672
2014-04-09 19:32:32,529 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:32:32,530 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 55, total: 650, max: 672
2014-04-09 19:32:32,530 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 5, with threshold: 2
2014-04-09 19:32:32,530 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 55, total: 650, max: 672
2014-04-09 19:32:32,530 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 7, with threshold: 2
2014-04-09 19:32:32,530 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 55, total: 650, max: 672
2014-04-09 19:32:32,531 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:32:32,532 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:32:32,533 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0007_m_000001_0 is done. And is in the process of commiting
2014-04-09 19:32:35,509 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt:0+51
2014-04-09 19:32:35,510 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0007_m_000001_0' done.
2014-04-09 19:32:35,517 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@675d552b
2014-04-09 19:32:35,518 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:32:35,519 INFO mapred.Merger (Merger.java:merge(390)) - Merging 2 sorted segments
2014-04-09 19:32:35,519 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 2 segments left of total size: 238 bytes
2014-04-09 19:32:35,519 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:32:35,520 INFO hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:32:35,520 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:32:35,526 INFO hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(count-lhs+count-rhs)[by: count-lhs:[{1}:'char'] count-rhs:[{1}:'char']]
2014-04-09 19:32:35,526 INFO hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextDelimited[['char', 'count']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/mergecount"]
2014-04-09 19:32:35,529 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0007_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:32:35,529 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:32:35,530 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0007_r_000000_0 is allowed to commit now
2014-04-09 19:32:35,531 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0007_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/mergecount
2014-04-09 19:32:38,517 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:32:38,518 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0007_r_000000_0' done.
2014-04-09 19:32:38,523 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/mergecount/_temporary
2014-04-09 19:32:38,531 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:38,536 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:38,537 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/mergecount
2014-04-09 19:32:38,543 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:32:38,543 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:32:38,557 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [max] starting
2014-04-09 19:32:38,558 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [max] source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:32:38,558 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [max] sink: Hfs["TextDelimited[['num', 'max']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/maxbystring"]
2014-04-09 19:32:38,558 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [max] parallel execution is enabled: false
2014-04-09 19:32:38,558 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [max] starting jobs: 1
2014-04-09 19:32:38,558 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [max] allocating threads: 1
2014-04-09 19:32:38,559 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [max] starting step: (1/1) ...lpersplatform/maxbystring
2014-04-09 19:32:38,569 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:38,589 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [max] submitted hadoop job: job_local_0008
2014-04-09 19:32:38,590 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [max] tracking url: http://localhost:8080/
2014-04-09 19:32:38,591 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@50a09f36
2014-04-09 19:32:38,592 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:32:38,592 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:32:38,592 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:32:38,603 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:32:38,603 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:32:38,604 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:32:38,604 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:32:38,608 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:32:38,609 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(max)[by:[{1}:'num']]
2014-04-09 19:32:38,609 INFO assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:32:38,610 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:32:38,610 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 49, total: 631, max: 672
2014-04-09 19:32:38,610 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:32:38,610 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 49, total: 631, max: 672
2014-04-09 19:32:38,611 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:32:38,611 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:32:38,612 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0008_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:32:41,592 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:32:41,593 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0008_m_000000_0' done.
2014-04-09 19:32:41,597 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@47724e0c
2014-04-09 19:32:41,597 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:32:41,598 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 19:32:41,598 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 87 bytes
2014-04-09 19:32:41,599 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:32:41,599 INFO hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:32:41,599 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:32:41,604 INFO hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(max)[by:[{1}:'num']]
2014-04-09 19:32:41,604 INFO hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextDelimited[['num', 'max']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/maxbystring"]
2014-04-09 19:32:41,606 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0008_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:32:41,607 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:32:41,607 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0008_r_000000_0 is allowed to commit now
2014-04-09 19:32:41,608 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0008_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/maxbystring
2014-04-09 19:32:44,596 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:32:44,598 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0008_r_000000_0' done.
2014-04-09 19:32:44,604 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/maxbystring/_temporary
2014-04-09 19:32:44,614 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:44,621 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:44,622 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/maxbystring
2014-04-09 19:32:44,629 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:32:44,630 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:32:44,643 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [first] starting
2014-04-09 19:32:44,644 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [first] source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:32:44,644 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [first] sink: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/firstn"]
2014-04-09 19:32:44,644 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [first] parallel execution is enabled: false
2014-04-09 19:32:44,644 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [first] starting jobs: 1
2014-04-09 19:32:44,644 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [first] allocating threads: 1
2014-04-09 19:32:44,645 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [first] starting step: (1/1) ...blyhelpersplatform/firstn
2014-04-09 19:32:44,650 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:44,663 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [first] submitted hadoop job: job_local_0009
2014-04-09 19:32:44,664 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [first] tracking url: http://localhost:8080/
2014-04-09 19:32:44,666 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@35adc18f
2014-04-09 19:32:44,666 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:32:44,667 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:32:44,667 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:32:44,684 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:32:44,684 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:32:44,686 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:32:44,686 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:32:44,694 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:32:44,694 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(first)[by:[{1}:'num']]
2014-04-09 19:32:44,695 INFO assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:32:44,696 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:32:44,696 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 51, total: 631, max: 672
2014-04-09 19:32:44,697 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:32:44,697 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 51, total: 631, max: 672
2014-04-09 19:32:44,698 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:32:44,699 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:32:44,700 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0009_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:32:47,666 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:32:47,667 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0009_m_000000_0' done.
2014-04-09 19:32:47,671 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@7b771bf5
2014-04-09 19:32:47,671 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:32:47,673 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 19:32:47,674 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 122 bytes
2014-04-09 19:32:47,674 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:32:47,675 INFO hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:32:47,675 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:32:47,682 INFO hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(first)[by:[{1}:'num']]
2014-04-09 19:32:47,682 INFO hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/firstn"]
2014-04-09 19:32:47,686 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0009_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:32:47,686 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:32:47,687 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0009_r_000000_0 is allowed to commit now
2014-04-09 19:32:47,688 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0009_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/firstn
2014-04-09 19:32:50,671 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:32:50,672 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0009_r_000000_0' done.
2014-04-09 19:32:50,677 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/firstn/_temporary
2014-04-09 19:32:50,687 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:50,689 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/firstn
2014-04-09 19:32:50,700 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:32:50,700 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:32:50,710 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [coerce] starting
2014-04-09 19:32:50,710 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [coerce] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt"]
2014-04-09 19:32:50,711 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [coerce] sink: Hfs["TextLine[['line']->['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/coercefields"]
2014-04-09 19:32:50,711 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [coerce] parallel execution is enabled: false
2014-04-09 19:32:50,711 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [coerce] starting jobs: 1
2014-04-09 19:32:50,711 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [coerce] allocating threads: 1
2014-04-09 19:32:50,711 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [coerce] starting step: (1/1) ...persplatform/coercefields
2014-04-09 19:32:50,720 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:50,731 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [coerce] submitted hadoop job: job_local_0010
2014-04-09 19:32:50,731 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [coerce] tracking url: http://localhost:8080/
2014-04-09 19:32:50,732 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@ebeb918
2014-04-09 19:32:50,733 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt
2014-04-09 19:32:50,734 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 0
2014-04-09 19:32:50,736 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:32:50,736 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:32:50,742 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt"]
2014-04-09 19:32:50,742 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: Hfs["TextLine[['line']->['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/coercefields"]
2014-04-09 19:32:50,745 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0010_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:32:50,746 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:32:50,746 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0010_m_000000_0 is allowed to commit now
2014-04-09 19:32:50,747 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0010_m_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/coercefields
2014-04-09 19:32:53,732 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt:0+19
2014-04-09 19:32:53,734 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0010_m_000000_0' done.
2014-04-09 19:32:53,739 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/coercefields/_temporary
2014-04-09 19:32:53,748 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:53,749 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/coercefields
2014-04-09 19:32:53,754 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:32:53,755 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:32:53,764 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [count] starting
2014-04-09 19:32:53,764 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [count] source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:32:53,764 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [count] sink: Hfs["TextDelimited[['char', 'count']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/count"]
2014-04-09 19:32:53,764 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [count] parallel execution is enabled: false
2014-04-09 19:32:53,765 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [count] starting jobs: 1
2014-04-09 19:32:53,765 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [count] allocating threads: 1
2014-04-09 19:32:53,765 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] starting step: (1/1) ...mblyhelpersplatform/count
2014-04-09 19:32:53,775 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:53,795 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] submitted hadoop job: job_local_0011
2014-04-09 19:32:53,795 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] tracking url: http://localhost:8080/
2014-04-09 19:32:53,798 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@724d7044
2014-04-09 19:32:53,799 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:32:53,799 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:32:53,800 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:32:53,810 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:32:53,810 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:32:53,811 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:32:53,811 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:32:53,815 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:32:53,815 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(count)[by:[{1}:'char']]
2014-04-09 19:32:53,816 INFO assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:32:53,816 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:32:53,816 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 38, total: 621, max: 672
2014-04-09 19:32:53,817 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:32:53,817 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 38, total: 621, max: 672
2014-04-09 19:32:53,817 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 5, with threshold: 2
2014-04-09 19:32:53,817 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 38, total: 621, max: 672
2014-04-09 19:32:53,817 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 7, with threshold: 2
2014-04-09 19:32:53,817 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 38, total: 621, max: 672
2014-04-09 19:32:53,818 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:32:53,819 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:32:53,819 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0011_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:32:56,799 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:32:56,800 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0011_m_000000_0' done.
2014-04-09 19:32:56,803 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@5f5dbf82
2014-04-09 19:32:56,803 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:32:56,805 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 19:32:56,805 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 119 bytes
2014-04-09 19:32:56,805 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:32:56,806 INFO hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:32:56,806 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:32:56,812 INFO hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(count)[by:[{1}:'char']]
2014-04-09 19:32:56,812 INFO hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextDelimited[['char', 'count']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/count"]
2014-04-09 19:32:56,814 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0011_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:32:56,815 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:32:56,815 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0011_r_000000_0 is allowed to commit now
2014-04-09 19:32:56,816 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0011_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/count
2014-04-09 19:32:59,803 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:32:59,804 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0011_r_000000_0' done.
2014-04-09 19:32:59,810 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/count/_temporary
2014-04-09 19:32:59,819 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:59,824 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:59,824 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/count
2014-04-09 19:32:59,829 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:32:59,830 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:32:59,838 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [max] starting
2014-04-09 19:32:59,839 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [max] source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:32:59,839 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [max] sink: Hfs["TextDelimited[['char', 'max']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/maxby"]
2014-04-09 19:32:59,839 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [max] parallel execution is enabled: false
2014-04-09 19:32:59,839 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [max] starting jobs: 1
2014-04-09 19:32:59,839 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [max] allocating threads: 1
2014-04-09 19:32:59,840 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [max] starting step: (1/1) ...mblyhelpersplatform/maxby
2014-04-09 19:32:59,845 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:32:59,857 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [max] submitted hadoop job: job_local_0012
2014-04-09 19:32:59,857 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [max] tracking url: http://localhost:8080/
2014-04-09 19:32:59,860 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@6bd0757e
2014-04-09 19:32:59,861 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:32:59,862 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:32:59,862 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:32:59,878 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:32:59,878 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:32:59,879 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:32:59,879 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:32:59,884 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:32:59,884 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(max)[by:[{1}:'char']]
2014-04-09 19:32:59,884 INFO assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:32:59,884 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:32:59,884 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 46, total: 627, max: 672
2014-04-09 19:32:59,885 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:32:59,885 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 46, total: 627, max: 672
2014-04-09 19:32:59,885 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 5, with threshold: 2
2014-04-09 19:32:59,885 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 46, total: 627, max: 672
2014-04-09 19:32:59,886 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 7, with threshold: 2
2014-04-09 19:32:59,886 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 46, total: 627, max: 672
2014-04-09 19:32:59,886 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:32:59,887 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:32:59,888 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0012_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:33:02,860 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:33:02,861 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0012_m_000000_0' done.
2014-04-09 19:33:02,864 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@1b020bff
2014-04-09 19:33:02,864 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:33:02,866 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 19:33:02,866 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 155 bytes
2014-04-09 19:33:02,866 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:33:02,867 INFO hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:33:02,867 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:33:02,872 INFO hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(max)[by:[{1}:'char']]
2014-04-09 19:33:02,872 INFO hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextDelimited[['char', 'max']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/maxby"]
2014-04-09 19:33:02,874 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0012_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:33:02,875 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:33:02,875 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0012_r_000000_0 is allowed to commit now
2014-04-09 19:33:02,876 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0012_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/maxby
2014-04-09 19:33:05,864 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:33:05,865 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0012_r_000000_0' done.
2014-04-09 19:33:05,871 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/maxby/_temporary
2014-04-09 19:33:05,880 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:05,884 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:05,885 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/maxby
2014-04-09 19:33:05,890 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:33:05,890 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:33:05,899 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [min] starting
2014-04-09 19:33:05,899 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [min] source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:33:05,899 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [min] sink: Hfs["TextDelimited[['char', 'min']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/minby"]
2014-04-09 19:33:05,899 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [min] parallel execution is enabled: false
2014-04-09 19:33:05,899 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [min] starting jobs: 1
2014-04-09 19:33:05,899 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [min] allocating threads: 1
2014-04-09 19:33:05,900 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [min] starting step: (1/1) ...mblyhelpersplatform/minby
2014-04-09 19:33:05,907 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:05,917 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [min] submitted hadoop job: job_local_0013
2014-04-09 19:33:05,917 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [min] tracking url: http://localhost:8080/
2014-04-09 19:33:05,919 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@683df7bd
2014-04-09 19:33:05,920 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:33:05,921 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:33:05,921 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:33:05,936 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:33:05,936 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:33:05,937 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:33:05,937 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:33:05,941 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:33:05,941 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(min)[by:[{1}:'char']]
2014-04-09 19:33:05,942 INFO assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:33:05,942 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:33:05,942 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 34, total: 615, max: 672
2014-04-09 19:33:05,942 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:33:05,943 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 34, total: 615, max: 672
2014-04-09 19:33:05,943 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 5, with threshold: 2
2014-04-09 19:33:05,943 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 34, total: 615, max: 672
2014-04-09 19:33:05,943 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 7, with threshold: 2
2014-04-09 19:33:05,943 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 34, total: 615, max: 672
2014-04-09 19:33:05,943 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:33:05,944 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:33:05,945 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0013_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:33:08,920 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:33:08,921 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0013_m_000000_0' done.
2014-04-09 19:33:08,924 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@3c08e293
2014-04-09 19:33:08,924 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:33:08,926 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 19:33:08,926 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 155 bytes
2014-04-09 19:33:08,926 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:33:08,928 INFO hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:33:08,928 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:33:08,932 INFO hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(min)[by:[{1}:'char']]
2014-04-09 19:33:08,932 INFO hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextDelimited[['char', 'min']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/minby"]
2014-04-09 19:33:08,935 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0013_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:33:08,935 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:33:08,935 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0013_r_000000_0 is allowed to commit now
2014-04-09 19:33:08,936 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0013_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/minby
2014-04-09 19:33:11,924 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:33:11,925 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0013_r_000000_0' done.
2014-04-09 19:33:11,929 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/minby/_temporary
2014-04-09 19:33:11,938 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:11,942 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:11,943 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/minby
2014-04-09 19:33:11,948 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:33:11,948 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:33:11,957 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [sum] starting
2014-04-09 19:33:11,957 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [sum] source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:33:11,958 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [sum] sink: Hfs["TextDelimited[['char', 'sum']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/sum"]
2014-04-09 19:33:11,958 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [sum] parallel execution is enabled: false
2014-04-09 19:33:11,958 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [sum] starting jobs: 1
2014-04-09 19:33:11,958 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [sum] allocating threads: 1
2014-04-09 19:33:11,958 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [sum] starting step: (1/1) ...semblyhelpersplatform/sum
2014-04-09 19:33:11,967 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:11,981 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [sum] submitted hadoop job: job_local_0014
2014-04-09 19:33:11,981 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [sum] tracking url: http://localhost:8080/
2014-04-09 19:33:11,983 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@2b938c68
2014-04-09 19:33:11,983 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:33:11,984 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:33:11,984 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:33:11,995 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:33:11,996 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:33:11,996 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:33:11,996 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:33:12,001 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:33:12,001 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(sum)[by:[{1}:'char']]
2014-04-09 19:33:12,001 INFO assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:33:12,002 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:33:12,002 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 39, total: 622, max: 672
2014-04-09 19:33:12,002 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:33:12,002 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 39, total: 622, max: 672
2014-04-09 19:33:12,003 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 5, with threshold: 2
2014-04-09 19:33:12,003 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 39, total: 622, max: 672
2014-04-09 19:33:12,003 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 7, with threshold: 2
2014-04-09 19:33:12,003 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 39, total: 622, max: 672
2014-04-09 19:33:12,003 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:33:12,004 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:33:12,005 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0014_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:33:14,983 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:33:14,984 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0014_m_000000_0' done.
2014-04-09 19:33:14,987 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@40d638d
2014-04-09 19:33:14,988 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:33:14,989 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 19:33:14,989 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 119 bytes
2014-04-09 19:33:14,989 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:33:14,989 INFO hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:33:14,989 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:33:14,994 INFO hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(sum)[by:[{1}:'char']]
2014-04-09 19:33:14,994 INFO hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextDelimited[['char', 'sum']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/sum"]
2014-04-09 19:33:14,996 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0014_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:33:14,996 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:33:14,997 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0014_r_000000_0 is allowed to commit now
2014-04-09 19:33:14,997 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0014_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/sum
2014-04-09 19:33:17,987 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:33:17,989 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0014_r_000000_0' done.
2014-04-09 19:33:17,997 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/sum/_temporary
2014-04-09 19:33:18,002 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:18,006 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:18,007 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/sum
2014-04-09 19:33:18,013 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:33:18,013 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:33:18,029 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [sum-lhs+sum-rhs] starting
2014-04-09 19:33:18,030 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [sum-lhs+sum-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt"]
2014-04-09 19:33:18,030 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [sum-lhs+sum-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:33:18,030 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [sum-lhs+sum-rhs] sink: Hfs["TextDelimited[['char', 'sum']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/mergesum"]
2014-04-09 19:33:18,030 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [sum-lhs+sum-rhs] parallel execution is enabled: false
2014-04-09 19:33:18,030 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [sum-lhs+sum-rhs] starting jobs: 1
2014-04-09 19:33:18,030 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [sum-lhs+sum-rhs] allocating threads: 1
2014-04-09 19:33:18,031 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [sum-lhs+sum-rhs] starting step: (1/1) ...yhelpersplatform/mergesum
2014-04-09 19:33:18,035 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:18,035 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:18,044 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [sum-lhs+sum-rhs] submitted hadoop job: job_local_0015
2014-04-09 19:33:18,045 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [sum-lhs+sum-rhs] tracking url: http://localhost:8080/
2014-04-09 19:33:18,047 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@2058690e
2014-04-09 19:33:18,048 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:33:18,049 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:33:18,049 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:33:18,060 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:33:18,061 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:33:18,061 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:33:18,061 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:33:18,066 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:33:18,067 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(sum-lhs+sum-rhs)[by: sum-lhs:[{1}:'char'] sum-rhs:[{1}:'char']]
2014-04-09 19:33:18,067 INFO assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:33:18,067 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:33:18,067 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 24, total: 610, max: 672
2014-04-09 19:33:18,068 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:33:18,068 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 24, total: 610, max: 672
2014-04-09 19:33:18,068 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 5, with threshold: 2
2014-04-09 19:33:18,068 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 24, total: 610, max: 672
2014-04-09 19:33:18,069 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 7, with threshold: 2
2014-04-09 19:33:18,069 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 24, total: 610, max: 672
2014-04-09 19:33:18,069 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:33:18,070 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:33:18,071 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0015_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:33:21,047 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:33:21,048 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0015_m_000000_0' done.
2014-04-09 19:33:21,058 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@15b3f6a8
2014-04-09 19:33:21,060 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt
2014-04-09 19:33:21,061 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:33:21,061 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:33:21,074 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:33:21,074 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:33:21,075 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:33:21,075 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:33:21,080 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt"]
2014-04-09 19:33:21,080 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(sum-lhs+sum-rhs)[by: sum-lhs:[{1}:'char'] sum-rhs:[{1}:'char']]
2014-04-09 19:33:21,081 INFO assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:33:21,082 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:33:21,083 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 35, total: 616, max: 672
2014-04-09 19:33:21,083 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:33:21,083 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 35, total: 616, max: 672
2014-04-09 19:33:21,084 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 5, with threshold: 2
2014-04-09 19:33:21,084 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 35, total: 616, max: 672
2014-04-09 19:33:21,084 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 7, with threshold: 2
2014-04-09 19:33:21,084 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 35, total: 616, max: 672
2014-04-09 19:33:21,084 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:33:21,085 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:33:21,086 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0015_m_000001_0 is done. And is in the process of commiting
2014-04-09 19:33:24,050 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt:0+51
2014-04-09 19:33:24,051 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0015_m_000001_0' done.
2014-04-09 19:33:24,056 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@6a738a66
2014-04-09 19:33:24,056 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:33:24,058 INFO mapred.Merger (Merger.java:merge(390)) - Merging 2 sorted segments
2014-04-09 19:33:24,058 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 2 segments left of total size: 238 bytes
2014-04-09 19:33:24,058 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:33:24,059 INFO hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:33:24,059 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:33:24,064 INFO hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(sum-lhs+sum-rhs)[by: sum-lhs:[{1}:'char'] sum-rhs:[{1}:'char']]
2014-04-09 19:33:24,064 INFO hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextDelimited[['char', 'sum']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/mergesum"]
2014-04-09 19:33:24,066 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0015_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:33:24,067 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:33:24,067 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0015_r_000000_0 is allowed to commit now
2014-04-09 19:33:24,068 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0015_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/mergesum
2014-04-09 19:33:27,056 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:33:27,057 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0015_r_000000_0' done.
2014-04-09 19:33:27,061 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/mergesum/_temporary
2014-04-09 19:33:27,071 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:27,075 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:27,076 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/mergesum
2014-04-09 19:33:27,080 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:33:27,080 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:33:27,087 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [shape] starting
2014-04-09 19:33:27,087 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt"]
2014-04-09 19:33:27,087 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [shape] sink: Hfs["TextLine[['num']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/discardnarrow"]
2014-04-09 19:33:27,087 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [shape] parallel execution is enabled: false
2014-04-09 19:33:27,088 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [shape] starting jobs: 1
2014-04-09 19:33:27,088 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [shape] allocating threads: 1
2014-04-09 19:33:27,088 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] starting step: (1/1) ...ersplatform/discardnarrow
2014-04-09 19:33:27,096 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:27,105 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] submitted hadoop job: job_local_0016
2014-04-09 19:33:27,106 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] tracking url: http://localhost:8080/
2014-04-09 19:33:27,108 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@6a45ec3d
2014-04-09 19:33:27,109 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt
2014-04-09 19:33:27,110 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 0
2014-04-09 19:33:27,112 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:33:27,112 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:33:27,119 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt"]
2014-04-09 19:33:27,119 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: Hfs["TextLine[['num']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/discardnarrow"]
2014-04-09 19:33:27,119 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0016_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:33:27,120 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:33:27,120 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0016_m_000000_0 is allowed to commit now
2014-04-09 19:33:27,121 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0016_m_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/discardnarrow
2014-04-09 19:33:30,108 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt:0+19
2014-04-09 19:33:30,109 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0016_m_000000_0' done.
2014-04-09 19:33:30,113 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/discardnarrow/_temporary
2014-04-09 19:33:30,120 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:30,121 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/discardnarrow
2014-04-09 19:33:30,125 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:33:30,126 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:33:30,131 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [shape] starting
2014-04-09 19:33:30,132 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt"]
2014-04-09 19:33:30,132 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [shape] sink: Hfs["TextLine[['line']->['item', 'element']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/rename"]
2014-04-09 19:33:30,132 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [shape] parallel execution is enabled: false
2014-04-09 19:33:30,132 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [shape] starting jobs: 1
2014-04-09 19:33:30,132 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [shape] allocating threads: 1
2014-04-09 19:33:30,133 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] starting step: (1/1) ...blyhelpersplatform/rename
2014-04-09 19:33:30,139 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:30,147 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] submitted hadoop job: job_local_0017
2014-04-09 19:33:30,147 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] tracking url: http://localhost:8080/
2014-04-09 19:33:30,149 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@580d63fe
2014-04-09 19:33:30,150 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt
2014-04-09 19:33:30,151 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 0
2014-04-09 19:33:30,153 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:33:30,154 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:33:30,159 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt"]
2014-04-09 19:33:30,159 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: Hfs["TextLine[['line']->['item', 'element']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/rename"]
2014-04-09 19:33:30,160 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0017_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:33:30,160 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:33:30,160 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0017_m_000000_0 is allowed to commit now
2014-04-09 19:33:30,161 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0017_m_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/rename
2014-04-09 19:33:33,149 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt:0+19
2014-04-09 19:33:33,150 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0017_m_000000_0' done.
2014-04-09 19:33:33,154 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/rename/_temporary
2014-04-09 19:33:33,161 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:33,162 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/rename
2014-04-09 19:33:33,168 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:33:33,169 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:33:33,184 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [name] starting
2014-04-09 19:33:33,184 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt"]
2014-04-09 19:33:33,184 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:33:33,184 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [name] sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/multimerge+true"]
2014-04-09 19:33:33,184 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [name] parallel execution is enabled: false
2014-04-09 19:33:33,185 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [name] starting jobs: 1
2014-04-09 19:33:33,185 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [name] allocating threads: 1
2014-04-09 19:33:33,185 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [name] starting step: (1/1) ...splatform/multimerge+true
2014-04-09 19:33:33,190 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:33,190 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:33,198 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [name] submitted hadoop job: job_local_0018
2014-04-09 19:33:33,198 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [name] tracking url: http://localhost:8080/
2014-04-09 19:33:33,200 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@ec64756
2014-04-09 19:33:33,201 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:33:33,202 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:33:33,202 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:33:33,284 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:33:33,284 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:33:33,285 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:33:33,285 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:33:33,295 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:33:33,295 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2014-04-09 19:33:33,296 INFO assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:33:33,297 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:33:33,297 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 242, total: 348, max: 672
2014-04-09 19:33:33,297 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 51% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:33:33,298 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:33:33,298 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 242, total: 348, max: 672
2014-04-09 19:33:33,298 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 51% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:33:33,299 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 5, with threshold: 2
2014-04-09 19:33:33,299 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 242, total: 348, max: 672
2014-04-09 19:33:33,299 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 51% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:33:33,299 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 7, with threshold: 2
2014-04-09 19:33:33,299 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 242, total: 348, max: 672
2014-04-09 19:33:33,299 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 51% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:33:33,300 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:33:33,301 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:33:33,301 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0018_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:33:36,200 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:33:36,201 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0018_m_000000_0' done.
2014-04-09 19:33:36,203 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@341e00e1
2014-04-09 19:33:36,204 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt
2014-04-09 19:33:36,205 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:33:36,205 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:33:36,217 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:33:36,217 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:33:36,217 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:33:36,217 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:33:36,225 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt"]
2014-04-09 19:33:36,225 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2014-04-09 19:33:36,225 INFO assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:33:36,227 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:33:36,227 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 139, total: 348, max: 672
2014-04-09 19:33:36,227 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 51% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:33:36,227 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:33:36,227 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 139, total: 348, max: 672
2014-04-09 19:33:36,227 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 51% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:33:36,228 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 5, with threshold: 2
2014-04-09 19:33:36,228 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 139, total: 348, max: 672
2014-04-09 19:33:36,228 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 51% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:33:36,228 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 7, with threshold: 2
2014-04-09 19:33:36,229 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 139, total: 348, max: 672
2014-04-09 19:33:36,229 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 51% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:33:36,229 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:33:36,230 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:33:36,230 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0018_m_000001_0 is done. And is in the process of commiting
2014-04-09 19:33:39,203 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt:0+51
2014-04-09 19:33:39,204 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0018_m_000001_0' done.
2014-04-09 19:33:39,208 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@769ceb67
2014-04-09 19:33:39,209 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:33:39,209 INFO mapred.Merger (Merger.java:merge(390)) - Merging 2 sorted segments
2014-04-09 19:33:39,209 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 2 segments left of total size: 472 bytes
2014-04-09 19:33:39,210 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:33:39,210 INFO hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:33:39,210 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:33:39,216 INFO hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(name)[by:[{1}:'char']]
2014-04-09 19:33:39,216 INFO hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/multimerge+true"]
2014-04-09 19:33:39,219 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0018_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:33:39,219 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:33:39,219 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0018_r_000000_0 is allowed to commit now
2014-04-09 19:33:39,220 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0018_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/multimerge+true
2014-04-09 19:33:42,208 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:33:42,210 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0018_r_000000_0' done.
2014-04-09 19:33:42,221 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/multimerge+true/_temporary
2014-04-09 19:33:42,230 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:42,239 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:42,239 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/multimerge+true
2014-04-09 19:33:42,245 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:33:42,245 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:33:42,270 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [second] starting
2014-04-09 19:33:42,270 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [second] source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:33:42,270 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [second] sink: Hfs["TextDelimited[['char', 'count']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/samesourcemergecount"]
2014-04-09 19:33:42,270 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [second] parallel execution is enabled: false
2014-04-09 19:33:42,271 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [second] starting jobs: 2
2014-04-09 19:33:42,271 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [second] allocating threads: 1
2014-04-09 19:33:42,271 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [second] starting step: (1/2)
2014-04-09 19:33:42,279 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:42,292 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [second] submitted hadoop job: job_local_0019
2014-04-09 19:33:42,292 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [second] tracking url: http://localhost:8080/
2014-04-09 19:33:42,294 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@71fecc5e
2014-04-09 19:33:42,295 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:33:42,296 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:33:42,296 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:33:42,307 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:33:42,307 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:33:42,308 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:33:42,308 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:33:42,313 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:33:42,313 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(first)[by:[{1}:'char']]
2014-04-09 19:33:42,313 INFO assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:33:42,315 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:33:42,315 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 120, total: 443, max: 672
2014-04-09 19:33:42,315 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 65% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:33:42,315 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:33:42,316 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 120, total: 443, max: 672
2014-04-09 19:33:42,316 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 65% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:33:42,316 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 5, with threshold: 2
2014-04-09 19:33:42,316 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 120, total: 443, max: 672
2014-04-09 19:33:42,316 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 65% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:33:42,316 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 7, with threshold: 2
2014-04-09 19:33:42,316 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 120, total: 443, max: 672
2014-04-09 19:33:42,316 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 65% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:33:42,317 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:33:42,318 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:33:42,318 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0019_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:33:45,294 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:33:45,295 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0019_m_000000_0' done.
2014-04-09 19:33:45,298 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@3899abfc
2014-04-09 19:33:45,298 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:33:45,299 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 19:33:45,299 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 119 bytes
2014-04-09 19:33:45,299 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:33:45,300 INFO hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:33:45,300 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:33:45,304 INFO hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(first)[by:[{1}:'char']]
2014-04-09 19:33:45,304 INFO hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: TempHfs["SequenceFile[['char', 'count']]"][457268092/first/]
2014-04-09 19:33:45,306 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0019_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:33:45,306 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:33:45,306 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0019_r_000000_0 is allowed to commit now
2014-04-09 19:33:45,307 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0019_r_000000_0' to file:/tmp/hadoop-brock/457268092_first_4C4A60FD4C1B4E8B918C5014C76416B8
2014-04-09 19:33:48,298 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:33:48,299 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0019_r_000000_0' done.
2014-04-09 19:33:48,302 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [second] starting step: (2/2) ...form/samesourcemergecount
2014-04-09 19:33:48,309 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:48,322 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [second] submitted hadoop job: job_local_0020
2014-04-09 19:33:48,322 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [second] tracking url: http://localhost:8080/
2014-04-09 19:33:48,325 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@24fa5c93
2014-04-09 19:33:48,326 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-brock/457268092_first_4C4A60FD4C1B4E8B918C5014C76416B8/part-00000
2014-04-09 19:33:48,327 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:33:48,327 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:33:48,337 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:33:48,337 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:33:48,338 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:33:48,338 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:33:48,345 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][457268092/first/]
2014-04-09 19:33:48,345 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(second)[by:[{1}:'char']]
2014-04-09 19:33:48,345 INFO assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:33:48,346 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:33:48,346 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 109, total: 538, max: 672
2014-04-09 19:33:48,347 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:33:48,347 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 109, total: 538, max: 672
2014-04-09 19:33:48,347 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:33:48,348 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:33:48,349 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0020_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:33:51,325 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/tmp/hadoop-brock/457268092_first_4C4A60FD4C1B4E8B918C5014C76416B8/part-00000:0+160
2014-04-09 19:33:51,326 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0020_m_000000_0' done.
2014-04-09 19:33:51,328 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@30cc684b
2014-04-09 19:33:51,328 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:33:51,329 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 19:33:51,329 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 67 bytes
2014-04-09 19:33:51,329 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:33:51,330 INFO hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:33:51,330 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:33:51,334 INFO hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(second)[by:[{1}:'char']]
2014-04-09 19:33:51,335 INFO hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextDelimited[['char', 'count']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/samesourcemergecount"]
2014-04-09 19:33:51,336 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0020_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:33:51,337 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:33:51,337 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0020_r_000000_0 is allowed to commit now
2014-04-09 19:33:51,338 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0020_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/samesourcemergecount
2014-04-09 19:33:54,328 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:33:54,329 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0020_r_000000_0' done.
2014-04-09 19:33:54,333 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/samesourcemergecount/_temporary
2014-04-09 19:33:54,342 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:54,349 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:54,350 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/samesourcemergecount
2014-04-09 19:33:54,355 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:33:54,355 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:33:54,364 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [average] starting
2014-04-09 19:33:54,364 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [average] source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:33:54,364 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [average] sink: Hfs["TextDelimited[['char', 'average']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/average"]
2014-04-09 19:33:54,364 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [average] parallel execution is enabled: false
2014-04-09 19:33:54,364 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [average] starting jobs: 1
2014-04-09 19:33:54,364 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [average] allocating threads: 1
2014-04-09 19:33:54,365 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [average] starting step: (1/1) ...lyhelpersplatform/average
2014-04-09 19:33:54,370 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:33:54,380 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [average] submitted hadoop job: job_local_0021
2014-04-09 19:33:54,380 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [average] tracking url: http://localhost:8080/
2014-04-09 19:33:54,382 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@3cf79190
2014-04-09 19:33:54,383 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:33:54,384 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:33:54,384 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:33:54,396 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:33:54,396 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:33:54,397 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:33:54,397 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:33:54,401 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:33:54,401 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(average)[by:[{1}:'char']]
2014-04-09 19:33:54,401 INFO assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:33:54,402 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:33:54,402 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 70, total: 611, max: 672
2014-04-09 19:33:54,402 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:33:54,402 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 70, total: 611, max: 672
2014-04-09 19:33:54,403 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 5, with threshold: 2
2014-04-09 19:33:54,403 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 70, total: 611, max: 672
2014-04-09 19:33:54,403 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 7, with threshold: 2
2014-04-09 19:33:54,403 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 70, total: 611, max: 672
2014-04-09 19:33:54,404 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:33:54,405 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:33:54,406 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0021_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:33:57,382 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:33:57,383 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0021_m_000000_0' done.
2014-04-09 19:33:57,386 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@5bb111eb
2014-04-09 19:33:57,386 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:33:57,387 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 19:33:57,388 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 200 bytes
2014-04-09 19:33:57,388 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:33:57,388 INFO hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:33:57,388 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:33:57,392 INFO hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(average)[by:[{1}:'char']]
2014-04-09 19:33:57,392 INFO hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextDelimited[['char', 'average']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/average"]
2014-04-09 19:33:57,394 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0021_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:33:57,394 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:33:57,395 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0021_r_000000_0 is allowed to commit now
2014-04-09 19:33:57,396 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0021_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/average
2014-04-09 19:34:00,386 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:34:00,387 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0021_r_000000_0' done.
2014-04-09 19:34:00,396 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/average/_temporary
2014-04-09 19:34:00,400 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:00,404 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:00,404 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/average
2014-04-09 19:34:00,410 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:34:00,410 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:34:00,418 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [sum] starting
2014-04-09 19:34:00,418 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [sum] source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:34:00,419 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [sum] sink: Hfs["TextDelimited[['char', 'sum']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/sumnulls"]
2014-04-09 19:34:00,419 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [sum] parallel execution is enabled: false
2014-04-09 19:34:00,419 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [sum] starting jobs: 1
2014-04-09 19:34:00,419 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [sum] allocating threads: 1
2014-04-09 19:34:00,420 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [sum] starting step: (1/1) ...yhelpersplatform/sumnulls
2014-04-09 19:34:00,427 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:00,435 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [sum] submitted hadoop job: job_local_0022
2014-04-09 19:34:00,435 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [sum] tracking url: http://localhost:8080/
2014-04-09 19:34:00,437 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@3d63d4c4
2014-04-09 19:34:00,438 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:34:00,439 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:34:00,439 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:34:00,503 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:34:00,503 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:34:00,504 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:34:00,504 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:34:00,508 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:34:00,508 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(sum)[by:[{1}:'char']]
2014-04-09 19:34:00,509 INFO assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:34:00,511 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:34:00,512 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 245, total: 352, max: 672
2014-04-09 19:34:00,512 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 52% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:34:00,512 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:34:00,512 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 245, total: 352, max: 672
2014-04-09 19:34:00,512 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 52% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:34:00,513 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 5, with threshold: 2
2014-04-09 19:34:00,513 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 245, total: 352, max: 672
2014-04-09 19:34:00,513 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 52% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:34:00,513 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 7, with threshold: 2
2014-04-09 19:34:00,513 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 245, total: 352, max: 672
2014-04-09 19:34:00,513 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 52% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:34:00,514 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:34:00,515 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:34:00,516 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0022_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:34:03,438 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:34:03,439 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0022_m_000000_0' done.
2014-04-09 19:34:03,441 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@cc270ff
2014-04-09 19:34:03,442 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:34:03,443 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 19:34:03,443 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 116 bytes
2014-04-09 19:34:03,443 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:34:03,444 INFO hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:34:03,444 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:34:03,450 INFO hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(sum)[by:[{1}:'char']]
2014-04-09 19:34:03,450 INFO hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextDelimited[['char', 'sum']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/sumnulls"]
2014-04-09 19:34:03,452 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0022_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:34:03,452 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:34:03,453 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0022_r_000000_0 is allowed to commit now
2014-04-09 19:34:03,453 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0022_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/sumnulls
2014-04-09 19:34:06,441 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:34:06,442 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0022_r_000000_0' done.
2014-04-09 19:34:06,451 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/sumnulls/_temporary
2014-04-09 19:34:06,460 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:06,468 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:06,469 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/sumnulls
2014-04-09 19:34:06,474 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:34:06,474 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:34:06,480 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [count] starting
2014-04-09 19:34:06,481 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [count] source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:34:06,481 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [count] sink: Hfs["TextDelimited[['count']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/countall"]
2014-04-09 19:34:06,481 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [count] parallel execution is enabled: false
2014-04-09 19:34:06,481 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [count] starting jobs: 1
2014-04-09 19:34:06,481 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [count] allocating threads: 1
2014-04-09 19:34:06,481 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] starting step: (1/1) ...yhelpersplatform/countall
2014-04-09 19:34:06,484 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:06,494 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] submitted hadoop job: job_local_0023
2014-04-09 19:34:06,494 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] tracking url: http://localhost:8080/
2014-04-09 19:34:06,496 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@1f34f843
2014-04-09 19:34:06,497 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:34:06,498 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:34:06,499 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:34:06,509 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:34:06,509 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:34:06,509 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:34:06,509 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:34:06,514 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:34:06,515 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(count)[by:[{?}:NONE]]
2014-04-09 19:34:06,515 INFO assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:34:06,516 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:34:06,517 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:34:06,518 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0023_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:34:09,497 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:34:09,498 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0023_m_000000_0' done.
2014-04-09 19:34:09,500 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@48ace6b4
2014-04-09 19:34:09,500 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:34:09,502 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 19:34:09,502 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 8 bytes
2014-04-09 19:34:09,502 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:34:09,503 INFO hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:34:09,503 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:34:09,509 INFO hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(count)[by:[{?}:NONE]]
2014-04-09 19:34:09,509 INFO hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextDelimited[['count']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/countall"]
2014-04-09 19:34:09,511 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0023_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:34:09,511 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:34:09,511 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0023_r_000000_0 is allowed to commit now
2014-04-09 19:34:09,512 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0023_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/countall
2014-04-09 19:34:12,500 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:34:12,501 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0023_r_000000_0' done.
2014-04-09 19:34:12,504 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/countall/_temporary
2014-04-09 19:34:12,511 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:12,514 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:12,515 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/countall
2014-04-09 19:34:12,520 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:34:12,521 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:34:12,530 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [name] starting
2014-04-09 19:34:12,531 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:34:12,531 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [name] sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average', 'average2', 'first']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/multi"]
2014-04-09 19:34:12,531 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [name] parallel execution is enabled: false
2014-04-09 19:34:12,531 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [name] starting jobs: 1
2014-04-09 19:34:12,531 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [name] allocating threads: 1
2014-04-09 19:34:12,531 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [name] starting step: (1/1) ...mblyhelpersplatform/multi
2014-04-09 19:34:12,535 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:12,543 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [name] submitted hadoop job: job_local_0024
2014-04-09 19:34:12,543 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [name] tracking url: http://localhost:8080/
2014-04-09 19:34:12,544 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@7ad138dd
2014-04-09 19:34:12,544 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:34:12,545 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:34:12,545 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:34:12,556 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:34:12,556 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:34:12,557 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:34:12,557 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:34:12,561 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:34:12,561 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2014-04-09 19:34:12,561 INFO assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:34:12,562 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:34:12,562 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 115, total: 447, max: 672
2014-04-09 19:34:12,562 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 66% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:34:12,563 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:34:12,563 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 115, total: 447, max: 672
2014-04-09 19:34:12,563 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 66% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:34:12,563 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 5, with threshold: 2
2014-04-09 19:34:12,563 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 115, total: 447, max: 672
2014-04-09 19:34:12,563 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 66% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:34:12,564 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 7, with threshold: 2
2014-04-09 19:34:12,564 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 115, total: 447, max: 672
2014-04-09 19:34:12,564 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 66% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-09 19:34:12,564 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:34:12,565 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:34:12,566 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0024_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:34:15,544 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:34:15,545 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0024_m_000000_0' done.
2014-04-09 19:34:15,548 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@f769e71
2014-04-09 19:34:15,548 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:34:15,549 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 19:34:15,549 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 452 bytes
2014-04-09 19:34:15,549 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:34:15,550 INFO hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:34:15,550 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:34:15,554 INFO hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(name)[by:[{1}:'char']]
2014-04-09 19:34:15,554 INFO hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average', 'average2', 'first']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/multi"]
2014-04-09 19:34:15,557 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0024_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:34:15,557 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:34:15,558 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0024_r_000000_0 is allowed to commit now
2014-04-09 19:34:15,558 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0024_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/multi
2014-04-09 19:34:18,548 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:34:18,549 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0024_r_000000_0' done.
2014-04-09 19:34:18,552 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/multi/_temporary
2014-04-09 19:34:18,560 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:18,569 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:18,569 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/multi
2014-04-09 19:34:18,573 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:34:18,574 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:34:18,579 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [shape] starting
2014-04-09 19:34:18,579 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt"]
2014-04-09 19:34:18,579 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [shape] sink: Hfs["TextLine[['num']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/retainnarrow"]
2014-04-09 19:34:18,579 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [shape] parallel execution is enabled: false
2014-04-09 19:34:18,579 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [shape] starting jobs: 1
2014-04-09 19:34:18,579 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [shape] allocating threads: 1
2014-04-09 19:34:18,580 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] starting step: (1/1) ...persplatform/retainnarrow
2014-04-09 19:34:18,583 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:18,591 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] submitted hadoop job: job_local_0025
2014-04-09 19:34:18,591 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] tracking url: http://localhost:8080/
2014-04-09 19:34:18,592 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@68ac8a06
2014-04-09 19:34:18,592 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt
2014-04-09 19:34:18,593 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 0
2014-04-09 19:34:18,594 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:34:18,594 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:34:18,596 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt"]
2014-04-09 19:34:18,596 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: Hfs["TextLine[['num']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/retainnarrow"]
2014-04-09 19:34:18,597 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0025_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:34:18,598 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:34:18,598 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0025_m_000000_0 is allowed to commit now
2014-04-09 19:34:18,599 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0025_m_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/retainnarrow
2014-04-09 19:34:21,592 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt:0+19
2014-04-09 19:34:21,593 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0025_m_000000_0' done.
2014-04-09 19:34:21,596 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/retainnarrow/_temporary
2014-04-09 19:34:21,605 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:21,607 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/retainnarrow
2014-04-09 19:34:21,616 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:34:21,616 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:34:21,622 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [shape] starting
2014-04-09 19:34:21,622 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt"]
2014-04-09 19:34:21,622 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [shape] sink: Hfs["TextLine[['item']->['char', 'item']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/renamenarrow"]
2014-04-09 19:34:21,623 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [shape] parallel execution is enabled: false
2014-04-09 19:34:21,623 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [shape] starting jobs: 1
2014-04-09 19:34:21,623 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [shape] allocating threads: 1
2014-04-09 19:34:21,624 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] starting step: (1/1) ...persplatform/renamenarrow
2014-04-09 19:34:21,629 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:21,637 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] submitted hadoop job: job_local_0026
2014-04-09 19:34:21,637 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] tracking url: http://localhost:8080/
2014-04-09 19:34:21,639 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@49740540
2014-04-09 19:34:21,640 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt
2014-04-09 19:34:21,641 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 0
2014-04-09 19:34:21,643 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:34:21,643 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:34:21,648 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt"]
2014-04-09 19:34:21,648 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: Hfs["TextLine[['item']->['char', 'item']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/renamenarrow"]
2014-04-09 19:34:21,649 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0026_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:34:21,649 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:34:21,650 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0026_m_000000_0 is allowed to commit now
2014-04-09 19:34:21,651 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0026_m_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/renamenarrow
2014-04-09 19:34:24,639 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt:0+19
2014-04-09 19:34:24,640 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0026_m_000000_0' done.
2014-04-09 19:34:24,643 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/renamenarrow/_temporary
2014-04-09 19:34:24,651 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:24,653 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/renamenarrow
2014-04-09 19:34:24,660 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:34:24,660 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:34:24,667 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [average] starting
2014-04-09 19:34:24,667 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [average] source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:34:24,668 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [average] sink: Hfs["TextDelimited[['char', 'average']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/averagenull"]
2014-04-09 19:34:24,668 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [average] parallel execution is enabled: false
2014-04-09 19:34:24,668 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [average] starting jobs: 1
2014-04-09 19:34:24,668 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [average] allocating threads: 1
2014-04-09 19:34:24,668 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [average] starting step: (1/1) ...lpersplatform/averagenull
2014-04-09 19:34:24,675 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:24,685 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [average] submitted hadoop job: job_local_0027
2014-04-09 19:34:24,685 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [average] tracking url: http://localhost:8080/
2014-04-09 19:34:24,687 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@6a8fa261
2014-04-09 19:34:24,688 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:34:24,689 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:34:24,689 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:34:24,699 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:34:24,699 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:34:24,700 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:34:24,700 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:34:24,704 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:34:24,704 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(average)[by:[{1}:'char']]
2014-04-09 19:34:24,704 INFO assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:34:24,706 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:34:24,706 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 79, total: 542, max: 672
2014-04-09 19:34:24,706 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:34:24,706 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 79, total: 542, max: 672
2014-04-09 19:34:24,707 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 5, with threshold: 2
2014-04-09 19:34:24,707 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 79, total: 542, max: 672
2014-04-09 19:34:24,707 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 7, with threshold: 2
2014-04-09 19:34:24,707 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 79, total: 542, max: 672
2014-04-09 19:34:24,707 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:34:24,708 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:34:24,709 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0027_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:34:27,687 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:34:27,688 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0027_m_000000_0' done.
2014-04-09 19:34:27,690 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@59aa724f
2014-04-09 19:34:27,690 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:34:27,690 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 19:34:27,690 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 200 bytes
2014-04-09 19:34:27,690 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:34:27,691 INFO hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:34:27,691 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:34:27,694 INFO hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(average)[by:[{1}:'char']]
2014-04-09 19:34:27,694 INFO hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextDelimited[['char', 'average']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/averagenull"]
2014-04-09 19:34:27,696 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0027_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:34:27,697 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:34:27,697 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0027_r_000000_0 is allowed to commit now
2014-04-09 19:34:27,698 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0027_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/averagenull
2014-04-09 19:34:30,690 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:34:30,691 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0027_r_000000_0' done.
2014-04-09 19:34:30,695 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/averagenull/_temporary
2014-04-09 19:34:30,703 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:30,710 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:30,710 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/averagenull
2014-04-09 19:34:30,714 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:34:30,714 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:34:30,719 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [coerce] starting
2014-04-09 19:34:30,720 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [coerce] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt"]
2014-04-09 19:34:30,720 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [coerce] sink: Hfs["TextLine[['line']->['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/coerce"]
2014-04-09 19:34:30,720 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [coerce] parallel execution is enabled: false
2014-04-09 19:34:30,720 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [coerce] starting jobs: 1
2014-04-09 19:34:30,720 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [coerce] allocating threads: 1
2014-04-09 19:34:30,721 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [coerce] starting step: (1/1) ...blyhelpersplatform/coerce
2014-04-09 19:34:30,727 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:30,737 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [coerce] submitted hadoop job: job_local_0028
2014-04-09 19:34:30,737 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [coerce] tracking url: http://localhost:8080/
2014-04-09 19:34:30,739 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@708ed3b
2014-04-09 19:34:30,740 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt
2014-04-09 19:34:30,740 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 0
2014-04-09 19:34:30,741 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:34:30,741 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:34:30,743 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt"]
2014-04-09 19:34:30,743 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: Hfs["TextLine[['line']->['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/coerce"]
2014-04-09 19:34:30,744 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0028_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:34:30,744 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:34:30,744 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0028_m_000000_0 is allowed to commit now
2014-04-09 19:34:30,745 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0028_m_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/coerce
2014-04-09 19:34:33,739 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lower.txt:0+19
2014-04-09 19:34:33,740 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0028_m_000000_0' done.
2014-04-09 19:34:33,742 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/coerce/_temporary
2014-04-09 19:34:33,751 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:33,752 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/coerce
2014-04-09 19:34:33,761 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:34:33,761 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:34:33,789 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [count-lhs*source*count...] starting
2014-04-09 19:34:33,790 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [count-lhs*source*count...] source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:34:33,790 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [count-lhs*source*count...] sink: Hfs["TextDelimited[['char', 'count']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/samesourcemergethreeway"]
2014-04-09 19:34:33,790 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [count-lhs*source*count...] parallel execution is enabled: false
2014-04-09 19:34:33,790 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [count-lhs*source*count...] starting jobs: 5
2014-04-09 19:34:33,790 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [count-lhs*source*count...] allocating threads: 1
2014-04-09 19:34:33,791 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] starting step: (1/5)
2014-04-09 19:34:33,797 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:33,805 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] submitted hadoop job: job_local_0029
2014-04-09 19:34:33,806 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2014-04-09 19:34:33,806 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@724d543f
2014-04-09 19:34:33,811 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:34:33,812 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:34:33,812 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:34:33,823 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:34:33,823 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:34:33,824 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:34:33,824 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:34:33,827 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:34:33,828 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(source)[by:[{1}:'char']]
2014-04-09 19:34:33,828 INFO assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:34:33,828 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:34:33,828 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 81, total: 576, max: 672
2014-04-09 19:34:33,829 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:34:33,829 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 81, total: 576, max: 672
2014-04-09 19:34:33,829 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 5, with threshold: 2
2014-04-09 19:34:33,829 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 81, total: 576, max: 672
2014-04-09 19:34:33,829 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 7, with threshold: 2
2014-04-09 19:34:33,829 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 81, total: 576, max: 672
2014-04-09 19:34:33,830 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:34:33,831 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:34:33,831 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0029_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:34:36,807 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:34:36,808 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0029_m_000000_0' done.
2014-04-09 19:34:36,809 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@6ff28e4d
2014-04-09 19:34:36,809 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:34:36,810 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 19:34:36,810 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 119 bytes
2014-04-09 19:34:36,810 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:34:36,811 INFO hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:34:36,811 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:34:36,813 INFO hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(source)[by:[{1}:'char']]
2014-04-09 19:34:36,814 INFO hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: TempHfs["SequenceFile[['char', 'count']]"][1118294604/source/]
2014-04-09 19:34:36,815 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0029_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:34:36,816 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:34:36,816 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0029_r_000000_0 is allowed to commit now
2014-04-09 19:34:36,816 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0029_r_000000_0' to file:/tmp/hadoop-brock/1118294604_source_A37DC37CFA2545A08FDED273325894B3
2014-04-09 19:34:39,809 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:34:39,810 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0029_r_000000_0' done.
2014-04-09 19:34:39,814 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] starting step: (3/5)
2014-04-09 19:34:39,820 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:39,827 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] submitted hadoop job: job_local_0030
2014-04-09 19:34:39,827 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2014-04-09 19:34:39,829 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@3aa80ebe
2014-04-09 19:34:39,830 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-brock/1118294604_source_A37DC37CFA2545A08FDED273325894B3/part-00000
2014-04-09 19:34:39,831 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:34:39,831 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:34:39,844 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:34:39,844 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:34:39,845 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:34:39,845 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:34:39,848 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][1118294604/source/]
2014-04-09 19:34:39,848 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(count-lhs)[by:[{1}:'char']]
2014-04-09 19:34:39,848 INFO assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:34:39,849 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:34:39,849 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 46, total: 648, max: 672
2014-04-09 19:34:39,849 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:34:39,849 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 46, total: 648, max: 672
2014-04-09 19:34:39,849 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:34:39,850 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:34:39,851 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0030_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:34:42,829 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/tmp/hadoop-brock/1118294604_source_A37DC37CFA2545A08FDED273325894B3/part-00000:0+160
2014-04-09 19:34:42,830 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0030_m_000000_0' done.
2014-04-09 19:34:42,833 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@639adf08
2014-04-09 19:34:42,833 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:34:42,834 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 19:34:42,835 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 67 bytes
2014-04-09 19:34:42,835 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:34:42,836 INFO hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:34:42,836 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:34:42,840 INFO hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(count-lhs)[by:[{1}:'char']]
2014-04-09 19:34:42,840 INFO hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: TempHfs["SequenceFile[['char', 'count']]"][4928088765/count-lhs/]
2014-04-09 19:34:42,842 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0030_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:34:42,842 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:34:42,843 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0030_r_000000_0 is allowed to commit now
2014-04-09 19:34:42,843 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0030_r_000000_0' to file:/tmp/hadoop-brock/4928088765_count_lhs_CD4DA9329239427D9037FBBC6F4B46F8
2014-04-09 19:34:45,833 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:34:45,834 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0030_r_000000_0' done.
2014-04-09 19:34:45,836 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] starting step: (4/5)
2014-04-09 19:34:45,841 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:45,848 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] submitted hadoop job: job_local_0031
2014-04-09 19:34:45,849 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2014-04-09 19:34:45,850 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@40ac12e6
2014-04-09 19:34:45,851 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-brock/1118294604_source_A37DC37CFA2545A08FDED273325894B3/part-00000
2014-04-09 19:34:45,852 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:34:45,853 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:34:45,868 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:34:45,868 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:34:45,869 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:34:45,869 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:34:45,872 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][1118294604/source/]
2014-04-09 19:34:45,872 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(count-rhs)[by:[{1}:'char']]
2014-04-09 19:34:45,872 INFO assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:34:45,872 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-09 19:34:45,873 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 80, total: 667, max: 672
2014-04-09 19:34:45,873 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-09 19:34:45,873 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 80, total: 667, max: 672
2014-04-09 19:34:45,873 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:34:45,874 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:34:45,874 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0031_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:34:48,851 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/tmp/hadoop-brock/1118294604_source_A37DC37CFA2545A08FDED273325894B3/part-00000:0+160
2014-04-09 19:34:48,851 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0031_m_000000_0' done.
2014-04-09 19:34:48,854 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@453180f7
2014-04-09 19:34:48,854 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:34:48,855 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 19:34:48,856 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 67 bytes
2014-04-09 19:34:48,856 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:34:48,857 INFO hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:34:48,857 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:34:48,860 INFO hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(count-rhs)[by:[{1}:'char']]
2014-04-09 19:34:48,860 INFO hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: TempHfs["SequenceFile[['char', 'count']]"][2414826741/count-rhs/]
2014-04-09 19:34:48,862 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0031_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:34:48,862 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:34:48,862 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0031_r_000000_0 is allowed to commit now
2014-04-09 19:34:48,863 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0031_r_000000_0' to file:/tmp/hadoop-brock/2414826741_count_rhs_2E8A78AB7CFA4D7FB534F2D024220D22
2014-04-09 19:34:51,854 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:34:51,855 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0031_r_000000_0' done.
2014-04-09 19:34:51,867 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] starting step: (2/5)
2014-04-09 19:34:51,871 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:51,871 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:34:51,878 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] submitted hadoop job: job_local_0032
2014-04-09 19:34:51,878 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2014-04-09 19:34:51,881 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@906b39f
2014-04-09 19:34:51,882 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-brock/1118294604_source_A37DC37CFA2545A08FDED273325894B3/part-00000
2014-04-09 19:34:51,884 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:34:51,884 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:34:51,903 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:34:51,903 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:34:51,904 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:34:51,905 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:34:51,910 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][1118294604/source/]
2014-04-09 19:34:51,910 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: CoGroup(source*count-rhs)[by: source:[{1}:'char'] count-rhs:[{1}:'char']]
2014-04-09 19:34:51,911 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:34:51,911 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:34:51,912 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0032_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:34:54,881 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/tmp/hadoop-brock/1118294604_source_A37DC37CFA2545A08FDED273325894B3/part-00000:0+160
2014-04-09 19:34:54,882 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0032_m_000000_0' done.
2014-04-09 19:34:54,884 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@3c098b
2014-04-09 19:34:54,885 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-brock/2414826741_count_rhs_2E8A78AB7CFA4D7FB534F2D024220D22/part-00000
2014-04-09 19:34:54,886 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:34:54,886 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:34:54,901 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:34:54,901 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:34:54,902 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:34:54,902 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:34:54,905 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][2414826741/count-rhs/]
2014-04-09 19:34:54,905 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: CoGroup(source*count-rhs)[by: source:[{1}:'char'] count-rhs:[{1}:'char']]
2014-04-09 19:34:54,906 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:34:54,906 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:34:54,907 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0032_m_000001_0 is done. And is in the process of commiting
2014-04-09 19:34:57,884 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/tmp/hadoop-brock/2414826741_count_rhs_2E8A78AB7CFA4D7FB534F2D024220D22/part-00000:0+160
2014-04-09 19:34:57,885 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0032_m_000001_0' done.
2014-04-09 19:34:57,888 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@1c9a8519
2014-04-09 19:34:57,888 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:34:57,889 INFO mapred.Merger (Merger.java:merge(390)) - Merging 2 sorted segments
2014-04-09 19:34:57,889 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 2 segments left of total size: 154 bytes
2014-04-09 19:34:57,889 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:34:57,890 INFO hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:34:57,890 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:34:57,893 INFO hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: CoGroup(source*count-rhs)[by: source:[{1}:'char'] count-rhs:[{1}:'char']]
2014-04-09 19:34:57,893 INFO hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: TempHfs["SequenceFile[['char', 'num', 'char2', 'count']]"][5990140638/source_count-rhs/]
2014-04-09 19:34:57,896 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2014-04-09 19:34:57,897 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2014-04-09 19:34:57,899 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0032_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:34:57,899 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:34:57,900 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0032_r_000000_0 is allowed to commit now
2014-04-09 19:34:57,900 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0032_r_000000_0' to file:/tmp/hadoop-brock/5990140638_source_count_rhs_F15FE30E40544D34A04BEECA63DBC72F
2014-04-09 19:35:00,888 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:35:00,889 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0032_r_000000_0' done.
2014-04-09 19:35:00,899 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] starting step: (5/5) ...m/samesourcemergethreeway
2014-04-09 19:35:00,905 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:35:00,906 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:35:00,914 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] submitted hadoop job: job_local_0033
2014-04-09 19:35:00,915 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2014-04-09 19:35:00,917 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@1591c3ce
2014-04-09 19:35:00,918 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-brock/5990140638_source_count_rhs_F15FE30E40544D34A04BEECA63DBC72F/part-00000
2014-04-09 19:35:00,918 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:35:00,919 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:35:00,933 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:35:00,933 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:35:00,934 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:35:00,934 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:35:00,938 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: TempHfs["SequenceFile[['char', 'num', 'char2', 'count']]"][5990140638/source_count-rhs/]
2014-04-09 19:35:00,939 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: CoGroup(count-lhs*source*count-rhs)[by: count-lhs:[{1}:'char'] source*count-rhs:[{1}:'char']]
2014-04-09 19:35:00,940 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:35:00,940 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:35:00,941 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0033_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:35:03,917 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/tmp/hadoop-brock/5990140638_source_count_rhs_F15FE30E40544D34A04BEECA63DBC72F/part-00000:0+200
2014-04-09 19:35:03,918 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0033_m_000000_0' done.
2014-04-09 19:35:03,919 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@161fd466
2014-04-09 19:35:03,919 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-brock/4928088765_count_lhs_CD4DA9329239427D9037FBBC6F4B46F8/part-00000
2014-04-09 19:35:03,920 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:35:03,921 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:35:03,931 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:35:03,931 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:35:03,932 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:35:03,932 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:35:03,936 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][4928088765/count-lhs/]
2014-04-09 19:35:03,936 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: CoGroup(count-lhs*source*count-rhs)[by: count-lhs:[{1}:'char'] source*count-rhs:[{1}:'char']]
2014-04-09 19:35:03,937 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:35:03,937 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:35:03,938 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0033_m_000001_0 is done. And is in the process of commiting
2014-04-09 19:35:06,919 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/tmp/hadoop-brock/4928088765_count_lhs_CD4DA9329239427D9037FBBC6F4B46F8/part-00000:0+160
2014-04-09 19:35:06,920 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0033_m_000001_0' done.
2014-04-09 19:35:06,924 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@66c0046
2014-04-09 19:35:06,925 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:35:06,926 INFO mapred.Merger (Merger.java:merge(390)) - Merging 2 sorted segments
2014-04-09 19:35:06,926 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 2 segments left of total size: 194 bytes
2014-04-09 19:35:06,926 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:35:06,927 INFO hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:35:06,927 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:35:06,931 INFO hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: CoGroup(count-lhs*source*count-rhs)[by: count-lhs:[{1}:'char'] source*count-rhs:[{1}:'char']]
2014-04-09 19:35:06,931 INFO hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextDelimited[['char', 'count']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/samesourcemergethreeway"]
2014-04-09 19:35:06,932 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2014-04-09 19:35:06,932 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2014-04-09 19:35:06,933 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0033_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:35:06,934 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:35:06,934 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0033_r_000000_0 is allowed to commit now
2014-04-09 19:35:06,935 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0033_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/samesourcemergethreeway
2014-04-09 19:35:09,924 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:35:09,925 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0033_r_000000_0' done.
2014-04-09 19:35:09,937 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/samesourcemergethreeway/_temporary
2014-04-09 19:35:09,946 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:35:09,954 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:35:09,956 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/samesourcemergethreeway
2014-04-09 19:35:09,962 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:35:09,962 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:35:09,971 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [lhs+rhs] starting
2014-04-09 19:35:09,971 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [lhs+rhs] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt"]
2014-04-09 19:35:09,971 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [lhs+rhs] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:35:09,971 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [lhs+rhs] sink: Hfs["TextLine[['item']->['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/uniquemerge-nondeterministic"]
2014-04-09 19:35:09,971 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [lhs+rhs] parallel execution is enabled: false
2014-04-09 19:35:09,972 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [lhs+rhs] starting jobs: 1
2014-04-09 19:35:09,972 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [lhs+rhs] allocating threads: 1
2014-04-09 19:35:09,972 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs+rhs] starting step: (1/1) ...quemerge-nondeterministic
2014-04-09 19:35:09,979 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:35:09,979 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:35:09,986 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs+rhs] submitted hadoop job: job_local_0034
2014-04-09 19:35:09,986 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs+rhs] tracking url: http://localhost:8080/
2014-04-09 19:35:09,988 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@4c058333
2014-04-09 19:35:09,989 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:35:09,989 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:35:09,989 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:35:10,004 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:35:10,004 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:35:10,005 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:35:10,005 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:35:10,008 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:35:10,008 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(lhs+rhs)[by: lhs:[{1}:'num'] rhs:[{1}:'num']]
2014-04-09 19:35:10,010 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:35:10,010 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:35:10,011 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0034_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:35:12,989 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:35:12,990 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0034_m_000000_0' done.
2014-04-09 19:35:12,991 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@4666d804
2014-04-09 19:35:12,992 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt
2014-04-09 19:35:12,993 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:35:12,993 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:35:13,005 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:35:13,005 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:35:13,006 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:35:13,006 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:35:13,009 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt"]
2014-04-09 19:35:13,009 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(lhs+rhs)[by: lhs:[{1}:'num'] rhs:[{1}:'num']]
2014-04-09 19:35:13,010 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:35:13,010 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:35:13,011 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0034_m_000001_0 is done. And is in the process of commiting
2014-04-09 19:35:15,991 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/rhs.txt:0+51
2014-04-09 19:35:15,992 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0034_m_000001_0' done.
2014-04-09 19:35:15,996 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@43169d2e
2014-04-09 19:35:15,997 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:35:15,998 INFO mapred.Merger (Merger.java:merge(390)) - Merging 2 sorted segments
2014-04-09 19:35:15,998 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 2 segments left of total size: 174 bytes
2014-04-09 19:35:15,998 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:35:15,999 INFO hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:35:15,999 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:35:16,001 INFO hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(lhs+rhs)[by: lhs:[{1}:'num'] rhs:[{1}:'num']]
2014-04-09 19:35:16,001 INFO hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextLine[['item']->['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/uniquemerge-nondeterministic"]
2014-04-09 19:35:16,004 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0034_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:35:16,004 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:35:16,004 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0034_r_000000_0 is allowed to commit now
2014-04-09 19:35:16,005 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0034_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/uniquemerge-nondeterministic
2014-04-09 19:35:18,996 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:35:18,997 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0034_r_000000_0' done.
2014-04-09 19:35:19,007 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/uniquemerge-nondeterministic/_temporary
2014-04-09 19:35:19,011 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:35:19,012 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/uniquemerge-nondeterministic
2014-04-09 19:35:19,018 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:35:19,018 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:35:19,029 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [shape] starting
2014-04-09 19:35:19,029 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:35:19,030 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [shape] sink: Hfs["TextLine[['item']->['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/unique"]
2014-04-09 19:35:19,030 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [shape] parallel execution is enabled: false
2014-04-09 19:35:19,030 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [shape] starting jobs: 1
2014-04-09 19:35:19,030 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [shape] allocating threads: 1
2014-04-09 19:35:19,031 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] starting step: (1/1) ...blyhelpersplatform/unique
2014-04-09 19:35:19,037 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:35:19,045 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] submitted hadoop job: job_local_0035
2014-04-09 19:35:19,045 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [shape] tracking url: http://localhost:8080/
2014-04-09 19:35:19,047 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@6f9a60c6
2014-04-09 19:35:19,047 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:35:19,048 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:35:19,048 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:35:19,063 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:35:19,063 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:35:19,064 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:35:19,064 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:35:19,066 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:35:19,066 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(shape)[by:[{1}:'num']]
2014-04-09 19:35:19,068 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:35:19,068 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:35:19,069 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0035_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:35:22,047 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:35:22,048 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0035_m_000000_0' done.
2014-04-09 19:35:22,049 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@1bc0b22b
2014-04-09 19:35:22,049 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:35:22,050 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 19:35:22,050 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 87 bytes
2014-04-09 19:35:22,050 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:35:22,051 INFO hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:35:22,051 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:35:22,053 INFO hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(shape)[by:[{1}:'num']]
2014-04-09 19:35:22,053 INFO hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextLine[['item']->['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/unique"]
2014-04-09 19:35:22,054 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0035_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:35:22,054 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:35:22,055 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0035_r_000000_0 is allowed to commit now
2014-04-09 19:35:22,055 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0035_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/unique
2014-04-09 19:35:25,049 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:35:25,050 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0035_r_000000_0' done.
2014-04-09 19:35:25,062 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/unique/_temporary
2014-04-09 19:35:25,069 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:35:25,069 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/unique
2014-04-09 19:35:25,076 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-09 19:35:25,076 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop/2.5.3/28aa68c14ec7f7fde8a1753ed3b6ac8e328e81dc/cascading-hadoop-2.5.3.jar
2014-04-09 19:35:25,083 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [count] starting
2014-04-09 19:35:25,083 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [count] source: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:35:25,084 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [count] sink: Hfs["TextDelimited[['notnull', 'null']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/countnullnotnull"]
2014-04-09 19:35:25,084 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [count] parallel execution is enabled: false
2014-04-09 19:35:25,084 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [count] starting jobs: 1
2014-04-09 19:35:25,084 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [count] allocating threads: 1
2014-04-09 19:35:25,084 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] starting step: (1/1) ...platform/countnullnotnull
2014-04-09 19:35:25,087 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:35:25,094 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] submitted hadoop job: job_local_0036
2014-04-09 19:35:25,094 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [count] tracking url: http://localhost:8080/
2014-04-09 19:35:25,096 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@36df9dd7
2014-04-09 19:35:25,097 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt
2014-04-09 19:35:25,098 INFO mapred.MapTask (MapTask.java:runOldMapper(425)) - numReduceTasks: 1
2014-04-09 19:35:25,099 INFO mapred.MapTask (MapTask.java:<init>(944)) - io.sort.mb = 100
2014-04-09 19:35:25,112 INFO mapred.MapTask (MapTask.java:<init>(956)) - data buffer = 79691776/99614720
2014-04-09 19:35:25,112 INFO mapred.MapTask (MapTask.java:<init>(957)) - record buffer = 262144/327680
2014-04-09 19:35:25,113 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-09 19:35:25,113 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-09 19:35:25,116 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt"]
2014-04-09 19:35:25,116 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(count)[by:[{?}:NONE]]
2014-04-09 19:35:25,116 INFO assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-09 19:35:25,119 INFO mapred.MapTask (MapTask.java:flush(1284)) - Starting flush of map output
2014-04-09 19:35:25,119 INFO mapred.MapTask (MapTask.java:sortAndSpill(1466)) - Finished spill 0
2014-04-09 19:35:25,120 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0036_m_000000_0 is done. And is in the process of commiting
2014-04-09 19:35:28,097 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/classes/test/data/lhs.txt:0+52
2014-04-09 19:35:28,097 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0036_m_000000_0' done.
2014-04-09 19:35:28,100 INFO mapred.Task (Task.java:initialize(534)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@2179e0ae
2014-04-09 19:35:28,100 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:35:28,100 INFO mapred.Merger (Merger.java:merge(390)) - Merging 1 sorted segments
2014-04-09 19:35:28,100 INFO mapred.Merger (Merger.java:merge(473)) - Down to the last merge-pass, with 1 segments left of total size: 10 bytes
2014-04-09 19:35:28,100 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:35:28,101 INFO hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-09 19:35:28,101 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-09 19:35:28,104 INFO hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(count)[by:[{?}:NONE]]
2014-04-09 19:35:28,104 INFO hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextDelimited[['notnull', 'null']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/countnullnotnull"]
2014-04-09 19:35:28,105 INFO mapred.Task (Task.java:done(847)) - Task:attempt_local_0036_r_000000_0 is done. And is in the process of commiting
2014-04-09 19:35:28,106 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) -
2014-04-09 19:35:28,106 INFO mapred.Task (Task.java:commit(1000)) - Task attempt_local_0036_r_000000_0 is allowed to commit now
2014-04-09 19:35:28,107 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(138)) - Saved output of task 'attempt_local_0036_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/countnullnotnull
2014-04-09 19:35:31,100 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(321)) - reduce > reduce
2014-04-09 19:35:31,101 INFO mapred.Task (Task.java:sendDone(959)) - Task 'attempt_local_0036_r_000000_0' done.
2014-04-09 19:35:31,105 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output/hadoop/assemblyhelpersplatform/countnullnotnull/_temporary
2014-04-09 19:35:31,113 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:35:31,121 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2014-04-09 19:35:31,122 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/apache-1.0.x/build/test/output//hadoop/assemblyhelpersplatform/countnullnotnull