2015-05-20 20:13:35,250 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(187)) - found 1 test platforms from classpath
2015-05-20 20:13:35,281 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(237)) - installing platform: hadoop2-mr1
2015-05-20 20:13:35,281 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(238)) - running test: cascading.pipe.assembly.AssemblyHelpersPlatformTest
2015-05-20 20:13:35,302 INFO hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(105)) - not using cluster
2015-05-20 20:13:35,770 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2015-05-20 20:13:36,107 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:13:36,108 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:13:36,118 INFO property.AppProps (AppProps.java:getAppID(169)) - using app.id: F30BDA93B7E74631AD6942C5DB65BE72
2015-05-20 20:13:36,321 INFO util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 2.7.0
2015-05-20 20:13:36,322 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] starting
2015-05-20 20:13:36,322 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt"]
2015-05-20 20:13:36,323 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:36,323 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/multimerge+false477"]
2015-05-20 20:13:36,323 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] parallel execution is enabled: false
2015-05-20 20:13:36,324 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] starting jobs: 1
2015-05-20 20:13:36,324 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] allocating threads: 1
2015-05-20 20:13:36,326 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [name] starting step: (1/1) ...tform/multimerge+false477
2015-05-20 20:13:36,704 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi693510948/.staging/job_local693510948_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:36,715 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi693510948/.staging/job_local693510948_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:36,793 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local693510948_0001/job_local693510948_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:36,793 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local693510948_0001/job_local693510948_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:36,801 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [name] submitted hadoop job: job_local693510948_0001
2015-05-20 20:13:36,801 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [name] tracking url: http://localhost:8080/
2015-05-20 20:13:36,846 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt
2015-05-20 20:13:36,907 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:36,908 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:36,953 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:36,953 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2015-05-20 20:13:36,969 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 20:13:36,969 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 171, total: 310, max: 672
2015-05-20 20:13:36,969 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 46% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:36,970 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 20:13:36,970 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 171, total: 310, max: 672
2015-05-20 20:13:36,970 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 46% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:36,971 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 20:13:36,971 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 171, total: 310, max: 672
2015-05-20 20:13:36,971 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 46% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:36,972 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 20:13:36,972 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 171, total: 310, max: 672
2015-05-20 20:13:36,972 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 46% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:37,008 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt
2015-05-20 20:13:37,024 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:37,024 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:37,041 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt"]
2015-05-20 20:13:37,041 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2015-05-20 20:13:37,101 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 20:13:37,101 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 195, total: 310, max: 672
2015-05-20 20:13:37,101 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 46% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:37,102 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 20:13:37,102 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 195, total: 310, max: 672
2015-05-20 20:13:37,102 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 46% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:37,103 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 20:13:37,103 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 195, total: 310, max: 672
2015-05-20 20:13:37,103 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 46% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:37,104 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 20:13:37,104 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 195, total: 310, max: 672
2015-05-20 20:13:37,105 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 46% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:37,139 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 20:13:37,140 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 20:13:37,165 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2015-05-20 20:13:37,165 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/multimerge+false477"]
2015-05-20 20:13:37,220 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/multimerge+false477/_temporary
2015-05-20 20:13:37,272 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/assemblyhelpersplatform/multimerge+false477
2015-05-20 20:13:37,293 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:13:37,293 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:13:37,327 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] starting
2015-05-20 20:13:37,328 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:37,328 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] sink: Hfs["TextDelimited[['num', 'min']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/minbystring"]
2015-05-20 20:13:37,328 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] parallel execution is enabled: false
2015-05-20 20:13:37,328 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] starting jobs: 1
2015-05-20 20:13:37,328 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] allocating threads: 1
2015-05-20 20:13:37,328 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [max] starting step: (1/1) ...lpersplatform/minbystring
2015-05-20 20:13:37,400 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi22968787/.staging/job_local22968787_0002/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:37,404 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi22968787/.staging/job_local22968787_0002/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:37,452 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local22968787_0002/job_local22968787_0002.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:37,453 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local22968787_0002/job_local22968787_0002.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:37,454 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [max] submitted hadoop job: job_local22968787_0002
2015-05-20 20:13:37,454 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [max] tracking url: http://localhost:8080/
2015-05-20 20:13:37,459 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt
2015-05-20 20:13:37,476 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:37,476 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:37,484 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:37,484 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(max)[by:[{1}:'num']]
2015-05-20 20:13:37,485 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 20:13:37,485 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 264, total: 412, max: 672
2015-05-20 20:13:37,485 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:37,486 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 20:13:37,486 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 264, total: 412, max: 672
2015-05-20 20:13:37,486 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:37,496 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 20:13:37,496 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 20:13:37,502 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(max)[by:[{1}:'num']]
2015-05-20 20:13:37,502 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['num', 'min']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/minbystring"]
2015-05-20 20:13:37,531 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/minbystring/_temporary
2015-05-20 20:13:37,592 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/assemblyhelpersplatform/minbystring
2015-05-20 20:13:37,617 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:13:37,618 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:13:37,646 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [average-lhs+average-rhs] starting
2015-05-20 20:13:37,646 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [average-lhs+average-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt"]
2015-05-20 20:13:37,647 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [average-lhs+average-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:37,647 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [average-lhs+average-rhs] sink: Hfs["TextDelimited[['char', 'average']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/mergeaverage"]
2015-05-20 20:13:37,647 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [average-lhs+average-rhs] parallel execution is enabled: false
2015-05-20 20:13:37,647 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [average-lhs+average-rhs] starting jobs: 1
2015-05-20 20:13:37,647 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [average-lhs+average-rhs] allocating threads: 1
2015-05-20 20:13:37,648 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [average-lhs+average-rhs] starting step: (1/1) ...persplatform/mergeaverage
2015-05-20 20:13:37,795 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi1156525874/.staging/job_local1156525874_0003/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:37,798 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi1156525874/.staging/job_local1156525874_0003/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:37,853 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local1156525874_0003/job_local1156525874_0003.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:37,854 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local1156525874_0003/job_local1156525874_0003.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:37,856 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [average-lhs+average-rhs] submitted hadoop job: job_local1156525874_0003
2015-05-20 20:13:37,856 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [average-lhs+average-rhs] tracking url: http://localhost:8080/
2015-05-20 20:13:37,862 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt
2015-05-20 20:13:37,892 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:37,893 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:37,901 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:37,901 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(average-lhs+average-rhs)[by: average-lhs:[{1}:'char'] average-rhs:[{1}:'char']]
2015-05-20 20:13:37,903 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 20:13:37,903 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 299, total: 410, max: 672
2015-05-20 20:13:37,903 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:37,904 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 20:13:37,904 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 299, total: 410, max: 672
2015-05-20 20:13:37,904 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:37,905 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 20:13:37,905 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 299, total: 410, max: 672
2015-05-20 20:13:37,905 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:37,906 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 20:13:37,906 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 299, total: 410, max: 672
2015-05-20 20:13:37,906 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:37,917 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt
2015-05-20 20:13:37,943 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:37,943 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:37,953 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt"]
2015-05-20 20:13:37,953 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(average-lhs+average-rhs)[by: average-lhs:[{1}:'char'] average-rhs:[{1}:'char']]
2015-05-20 20:13:37,956 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 20:13:37,956 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 197, total: 410, max: 672
2015-05-20 20:13:37,956 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:37,957 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 20:13:37,957 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 197, total: 410, max: 672
2015-05-20 20:13:37,957 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:37,958 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 20:13:37,958 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 197, total: 410, max: 672
2015-05-20 20:13:37,958 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:37,959 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 20:13:37,959 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 197, total: 410, max: 672
2015-05-20 20:13:37,959 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:37,972 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 20:13:37,972 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 20:13:37,981 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(average-lhs+average-rhs)[by: average-lhs:[{1}:'char'] average-rhs:[{1}:'char']]
2015-05-20 20:13:37,981 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'average']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/mergeaverage"]
2015-05-20 20:13:38,010 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/mergeaverage/_temporary
2015-05-20 20:13:38,062 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/assemblyhelpersplatform/mergeaverage
2015-05-20 20:13:38,079 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:13:38,079 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:13:38,092 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] starting
2015-05-20 20:13:38,092 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-05-20 20:13:38,092 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] sink: Hfs["TextLine[['line']->['item', 'element']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/renameall"]
2015-05-20 20:13:38,093 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] parallel execution is enabled: false
2015-05-20 20:13:38,093 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] starting jobs: 1
2015-05-20 20:13:38,093 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] allocating threads: 1
2015-05-20 20:13:38,093 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [shape] starting step: (1/1) ...helpersplatform/renameall
2015-05-20 20:13:38,176 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi733304035/.staging/job_local733304035_0004/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:38,178 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi733304035/.staging/job_local733304035_0004/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:38,211 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local733304035_0004/job_local733304035_0004.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:38,211 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local733304035_0004/job_local733304035_0004.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:38,212 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [shape] submitted hadoop job: job_local733304035_0004
2015-05-20 20:13:38,212 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [shape] tracking url: http://localhost:8080/
2015-05-20 20:13:38,216 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt
2015-05-20 20:13:38,222 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:38,222 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:38,227 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-05-20 20:13:38,227 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['line']->['item', 'element']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/renameall"]
2015-05-20 20:13:38,246 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/renameall/_temporary
2015-05-20 20:13:38,270 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/assemblyhelpersplatform/renameall
2015-05-20 20:13:38,286 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:13:38,286 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:13:38,311 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] starting
2015-05-20 20:13:38,312 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:38,312 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] sink: Hfs["TextDelimited[['count', 'count2']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/countcount"]
2015-05-20 20:13:38,312 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] parallel execution is enabled: false
2015-05-20 20:13:38,312 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] starting jobs: 2
2015-05-20 20:13:38,312 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] allocating threads: 1
2015-05-20 20:13:38,312 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count] starting step: (1/2)
2015-05-20 20:13:38,385 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi599527114/.staging/job_local599527114_0005/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:38,387 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi599527114/.staging/job_local599527114_0005/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:38,416 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local599527114_0005/job_local599527114_0005.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:38,417 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local599527114_0005/job_local599527114_0005.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:38,418 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count] submitted hadoop job: job_local599527114_0005
2015-05-20 20:13:38,418 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count] tracking url: http://localhost:8080/
2015-05-20 20:13:38,421 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt
2015-05-20 20:13:38,432 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:38,432 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:38,438 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:38,439 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(count)[by:[{1}:'char']]
2015-05-20 20:13:38,440 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 20:13:38,440 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 217, total: 411, max: 672
2015-05-20 20:13:38,440 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:38,440 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 20:13:38,440 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 217, total: 411, max: 672
2015-05-20 20:13:38,441 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:38,441 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 20:13:38,441 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 217, total: 411, max: 672
2015-05-20 20:13:38,441 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:38,442 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 20:13:38,442 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 217, total: 411, max: 672
2015-05-20 20:13:38,442 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:38,450 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 20:13:38,450 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 20:13:38,456 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(count)[by:[{1}:'char']]
2015-05-20 20:13:38,456 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: TempHfs["SequenceFile[['count', 'count2']]"][2749285546/count/]
2015-05-20 20:13:38,472 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 20:13:38,472 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 213, total: 411, max: 672
2015-05-20 20:13:38,472 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:38,510 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count] starting step: (2/2) ...elpersplatform/countcount
2015-05-20 20:13:38,580 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi1444601248/.staging/job_local1444601248_0006/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:38,581 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi1444601248/.staging/job_local1444601248_0006/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:38,614 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local1444601248_0006/job_local1444601248_0006.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:38,614 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local1444601248_0006/job_local1444601248_0006.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:38,615 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count] submitted hadoop job: job_local1444601248_0006
2015-05-20 20:13:38,615 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count] tracking url: http://localhost:8080/
2015-05-20 20:13:38,619 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-soberoi/2749285546_count_B7F1ED839E5644C497E97ED4381E843E/part-00000
2015-05-20 20:13:38,647 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:38,648 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:38,653 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: TempHfs["SequenceFile[['count', 'count2']]"][2749285546/count/]
2015-05-20 20:13:38,654 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(count)[by:[{1}:'count']]
2015-05-20 20:13:38,662 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 20:13:38,662 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 20:13:38,667 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(count)[by:[{1}:'count']]
2015-05-20 20:13:38,668 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['count', 'count2']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/countcount"]
2015-05-20 20:13:38,697 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/countcount/_temporary
2015-05-20 20:13:38,744 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/assemblyhelpersplatform/countcount
2015-05-20 20:13:38,759 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:13:38,759 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:13:38,777 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count-lhs+count-rhs] starting
2015-05-20 20:13:38,777 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count-lhs+count-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt"]
2015-05-20 20:13:38,778 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count-lhs+count-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:38,778 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count-lhs+count-rhs] sink: Hfs["TextDelimited[['char', 'count']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/mergecount"]
2015-05-20 20:13:38,778 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count-lhs+count-rhs] parallel execution is enabled: false
2015-05-20 20:13:38,778 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count-lhs+count-rhs] starting jobs: 1
2015-05-20 20:13:38,778 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count-lhs+count-rhs] allocating threads: 1
2015-05-20 20:13:38,779 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count-lhs+count-rhs] starting step: (1/1) ...elpersplatform/mergecount
2015-05-20 20:13:38,847 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi1145302663/.staging/job_local1145302663_0007/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:38,849 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi1145302663/.staging/job_local1145302663_0007/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:38,878 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local1145302663_0007/job_local1145302663_0007.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:38,878 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local1145302663_0007/job_local1145302663_0007.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:38,880 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count-lhs+count-rhs] submitted hadoop job: job_local1145302663_0007
2015-05-20 20:13:38,880 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count-lhs+count-rhs] tracking url: http://localhost:8080/
2015-05-20 20:13:38,885 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt
2015-05-20 20:13:38,905 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:38,905 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:38,911 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:38,911 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(count-lhs+count-rhs)[by: count-lhs:[{1}:'char'] count-rhs:[{1}:'char']]
2015-05-20 20:13:38,913 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 20:13:38,913 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 300, total: 410, max: 672
2015-05-20 20:13:38,913 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:38,913 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 20:13:38,913 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 300, total: 410, max: 672
2015-05-20 20:13:38,913 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:38,914 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 20:13:38,914 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 300, total: 410, max: 672
2015-05-20 20:13:38,914 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:38,914 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 20:13:38,914 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 300, total: 410, max: 672
2015-05-20 20:13:38,915 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:38,922 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt
2015-05-20 20:13:38,934 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:38,934 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:38,942 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt"]
2015-05-20 20:13:38,942 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(count-lhs+count-rhs)[by: count-lhs:[{1}:'char'] count-rhs:[{1}:'char']]
2015-05-20 20:13:38,945 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 20:13:38,945 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 198, total: 410, max: 672
2015-05-20 20:13:38,945 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:38,946 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 20:13:38,946 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 198, total: 410, max: 672
2015-05-20 20:13:38,946 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:38,947 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 20:13:38,947 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 198, total: 410, max: 672
2015-05-20 20:13:38,947 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:38,948 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 20:13:38,948 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 198, total: 410, max: 672
2015-05-20 20:13:38,948 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:38,959 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 20:13:38,960 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 20:13:38,968 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(count-lhs+count-rhs)[by: count-lhs:[{1}:'char'] count-rhs:[{1}:'char']]
2015-05-20 20:13:38,968 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'count']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/mergecount"]
2015-05-20 20:13:38,999 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/mergecount/_temporary
2015-05-20 20:13:39,041 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/assemblyhelpersplatform/mergecount
2015-05-20 20:13:39,055 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:13:39,055 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:13:39,069 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [min] starting
2015-05-20 20:13:39,070 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [min] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:39,070 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [min] sink: Hfs["TextDelimited[['char', 'min']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/minbynullsafety"]
2015-05-20 20:13:39,070 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [min] parallel execution is enabled: false
2015-05-20 20:13:39,070 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [min] starting jobs: 1
2015-05-20 20:13:39,070 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [min] allocating threads: 1
2015-05-20 20:13:39,071 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [min] starting step: (1/1) ...splatform/minbynullsafety
2015-05-20 20:13:39,139 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi715428401/.staging/job_local715428401_0008/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:39,141 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi715428401/.staging/job_local715428401_0008/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:39,169 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local715428401_0008/job_local715428401_0008.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:39,169 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local715428401_0008/job_local715428401_0008.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:39,170 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [min] submitted hadoop job: job_local715428401_0008
2015-05-20 20:13:39,171 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [min] tracking url: http://localhost:8080/
2015-05-20 20:13:39,174 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt
2015-05-20 20:13:39,186 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:39,186 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:39,192 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:39,192 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(min)[by:[{1}:'char']]
2015-05-20 20:13:39,193 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 20:13:39,193 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 263, total: 400, max: 672
2015-05-20 20:13:39,193 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 59% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:39,194 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 20:13:39,194 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 263, total: 400, max: 672
2015-05-20 20:13:39,194 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 59% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:39,195 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 20:13:39,195 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 263, total: 400, max: 672
2015-05-20 20:13:39,195 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 59% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:39,196 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 20:13:39,196 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 263, total: 400, max: 672
2015-05-20 20:13:39,196 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 59% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:39,204 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 20:13:39,205 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 20:13:39,211 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(min)[by:[{1}:'char']]
2015-05-20 20:13:39,211 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'min']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/minbynullsafety"]
2015-05-20 20:13:39,242 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/minbynullsafety/_temporary
2015-05-20 20:13:39,285 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/assemblyhelpersplatform/minbynullsafety
2015-05-20 20:13:39,300 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:13:39,301 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:13:39,316 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] starting
2015-05-20 20:13:39,316 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:39,316 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] sink: Hfs["TextDelimited[['num', 'max']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/maxbystring"]
2015-05-20 20:13:39,316 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] parallel execution is enabled: false
2015-05-20 20:13:39,317 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] starting jobs: 1
2015-05-20 20:13:39,317 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] allocating threads: 1
2015-05-20 20:13:39,317 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [max] starting step: (1/1) ...lpersplatform/maxbystring
2015-05-20 20:13:39,402 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi1336477977/.staging/job_local1336477977_0009/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:39,403 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi1336477977/.staging/job_local1336477977_0009/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:39,441 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local1336477977_0009/job_local1336477977_0009.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:39,442 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local1336477977_0009/job_local1336477977_0009.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:39,443 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [max] submitted hadoop job: job_local1336477977_0009
2015-05-20 20:13:39,443 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [max] tracking url: http://localhost:8080/
2015-05-20 20:13:39,455 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt
2015-05-20 20:13:39,480 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:39,481 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:39,487 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:39,487 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(max)[by:[{1}:'num']]
2015-05-20 20:13:39,489 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 20:13:39,489 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 300, total: 410, max: 672
2015-05-20 20:13:39,490 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:39,490 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 20:13:39,490 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 300, total: 410, max: 672
2015-05-20 20:13:39,491 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:39,501 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 20:13:39,501 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 20:13:39,508 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(max)[by:[{1}:'num']]
2015-05-20 20:13:39,508 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['num', 'max']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/maxbystring"]
2015-05-20 20:13:39,546 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/maxbystring/_temporary
2015-05-20 20:13:39,605 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/assemblyhelpersplatform/maxbystring
2015-05-20 20:13:39,624 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:13:39,625 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:13:39,649 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [first] starting
2015-05-20 20:13:39,649 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [first] source: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs+rhs-cross.txt"]
2015-05-20 20:13:39,649 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [first] sink: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/firstnfields"]
2015-05-20 20:13:39,649 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [first] parallel execution is enabled: false
2015-05-20 20:13:39,649 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [first] starting jobs: 1
2015-05-20 20:13:39,650 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [first] allocating threads: 1
2015-05-20 20:13:39,650 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [first] starting step: (1/1) ...persplatform/firstnfields
2015-05-20 20:13:39,725 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi2008353100/.staging/job_local2008353100_0010/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:39,727 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi2008353100/.staging/job_local2008353100_0010/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:39,757 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local2008353100_0010/job_local2008353100_0010.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:39,758 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local2008353100_0010/job_local2008353100_0010.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:39,758 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [first] submitted hadoop job: job_local2008353100_0010
2015-05-20 20:13:39,759 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [first] tracking url: http://localhost:8080/
2015-05-20 20:13:39,762 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs+rhs-cross.txt
2015-05-20 20:13:39,777 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:39,777 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:39,782 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs+rhs-cross.txt"]
2015-05-20 20:13:39,783 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(first)[by:[{1}:'num']]
2015-05-20 20:13:39,785 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 20:13:39,785 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 299, total: 410, max: 672
2015-05-20 20:13:39,785 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:39,786 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 20:13:39,786 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 299, total: 410, max: 672
2015-05-20 20:13:39,786 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:39,796 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 20:13:39,796 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 20:13:39,802 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(first)[by:[{1}:'num']]
2015-05-20 20:13:39,802 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/firstnfields"]
2015-05-20 20:13:39,831 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/firstnfields/_temporary
2015-05-20 20:13:39,858 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/assemblyhelpersplatform/firstnfields
2015-05-20 20:13:39,872 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:13:39,872 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:13:39,883 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [coerce] starting
2015-05-20 20:13:39,883 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [coerce] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-05-20 20:13:39,883 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [coerce] sink: Hfs["TextLine[['line']->['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/coercefields"]
2015-05-20 20:13:39,883 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [coerce] parallel execution is enabled: false
2015-05-20 20:13:39,884 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [coerce] starting jobs: 1
2015-05-20 20:13:39,884 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [coerce] allocating threads: 1
2015-05-20 20:13:39,884 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [coerce] starting step: (1/1) ...persplatform/coercefields
2015-05-20 20:13:39,938 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi809832526/.staging/job_local809832526_0011/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:39,939 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi809832526/.staging/job_local809832526_0011/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:39,964 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local809832526_0011/job_local809832526_0011.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:39,965 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local809832526_0011/job_local809832526_0011.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:39,965 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [coerce] submitted hadoop job: job_local809832526_0011
2015-05-20 20:13:39,966 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [coerce] tracking url: http://localhost:8080/
2015-05-20 20:13:39,968 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt
2015-05-20 20:13:39,973 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:39,974 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:39,978 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-05-20 20:13:39,979 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['line']->['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/coercefields"]
2015-05-20 20:13:40,006 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/coercefields/_temporary
2015-05-20 20:13:40,025 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/assemblyhelpersplatform/coercefields
2015-05-20 20:13:40,037 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:13:40,037 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:13:40,046 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] starting
2015-05-20 20:13:40,047 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:40,047 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] sink: Hfs["TextDelimited[['char', 'count']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/count"]
2015-05-20 20:13:40,047 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] parallel execution is enabled: false
2015-05-20 20:13:40,047 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] starting jobs: 1
2015-05-20 20:13:40,047 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] allocating threads: 1
2015-05-20 20:13:40,048 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count] starting step: (1/1) ...mblyhelpersplatform/count
2015-05-20 20:13:40,102 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi2020629364/.staging/job_local2020629364_0012/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:40,103 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi2020629364/.staging/job_local2020629364_0012/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:40,131 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local2020629364_0012/job_local2020629364_0012.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:40,131 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local2020629364_0012/job_local2020629364_0012.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:40,132 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count] submitted hadoop job: job_local2020629364_0012
2015-05-20 20:13:40,132 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count] tracking url: http://localhost:8080/
2015-05-20 20:13:40,134 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt
2015-05-20 20:13:40,149 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:40,150 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:40,155 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:40,155 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(count)[by:[{1}:'char']]
2015-05-20 20:13:40,156 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 20:13:40,156 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 298, total: 410, max: 672
2015-05-20 20:13:40,156 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:40,157 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 20:13:40,157 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 298, total: 410, max: 672
2015-05-20 20:13:40,157 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:40,157 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 20:13:40,157 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 298, total: 410, max: 672
2015-05-20 20:13:40,157 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:40,158 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 20:13:40,158 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 298, total: 410, max: 672
2015-05-20 20:13:40,158 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:40,166 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 20:13:40,166 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 20:13:40,171 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(count)[by:[{1}:'char']]
2015-05-20 20:13:40,171 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'count']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/count"]
2015-05-20 20:13:40,197 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/count/_temporary
2015-05-20 20:13:40,239 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/assemblyhelpersplatform/count
2015-05-20 20:13:40,252 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:13:40,253 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:13:40,265 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] starting
2015-05-20 20:13:40,265 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:40,265 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] sink: Hfs["TextDelimited[['char', 'max']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/maxby"]
2015-05-20 20:13:40,265 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] parallel execution is enabled: false
2015-05-20 20:13:40,265 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] starting jobs: 1
2015-05-20 20:13:40,265 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] allocating threads: 1
2015-05-20 20:13:40,266 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [max] starting step: (1/1) ...mblyhelpersplatform/maxby
2015-05-20 20:13:40,349 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi1813659654/.staging/job_local1813659654_0013/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:40,351 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi1813659654/.staging/job_local1813659654_0013/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:40,382 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local1813659654_0013/job_local1813659654_0013.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:40,382 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local1813659654_0013/job_local1813659654_0013.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:40,383 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [max] submitted hadoop job: job_local1813659654_0013
2015-05-20 20:13:40,383 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [max] tracking url: http://localhost:8080/
2015-05-20 20:13:40,387 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt
2015-05-20 20:13:40,402 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:40,402 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:40,407 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:40,407 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(max)[by:[{1}:'char']]
2015-05-20 20:13:40,408 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 20:13:40,408 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 299, total: 410, max: 672
2015-05-20 20:13:40,408 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:40,408 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 20:13:40,408 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 299, total: 410, max: 672
2015-05-20 20:13:40,408 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:40,409 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 20:13:40,409 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 299, total: 410, max: 672
2015-05-20 20:13:40,409 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:40,409 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 20:13:40,409 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 299, total: 410, max: 672
2015-05-20 20:13:40,409 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:40,417 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 20:13:40,417 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 20:13:40,422 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(max)[by:[{1}:'char']]
2015-05-20 20:13:40,422 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'max']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/maxby"]
2015-05-20 20:13:40,450 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/maxby/_temporary
2015-05-20 20:13:40,491 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/assemblyhelpersplatform/maxby
2015-05-20 20:13:40,502 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:13:40,502 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:13:40,511 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [min] starting
2015-05-20 20:13:40,511 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [min] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:40,511 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [min] sink: Hfs["TextDelimited[['char', 'min']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/minby"]
2015-05-20 20:13:40,511 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [min] parallel execution is enabled: false
2015-05-20 20:13:40,511 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [min] starting jobs: 1
2015-05-20 20:13:40,511 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [min] allocating threads: 1
2015-05-20 20:13:40,512 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [min] starting step: (1/1) ...mblyhelpersplatform/minby
2015-05-20 20:13:40,573 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi883212642/.staging/job_local883212642_0014/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:40,574 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi883212642/.staging/job_local883212642_0014/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:40,600 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local883212642_0014/job_local883212642_0014.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:40,600 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local883212642_0014/job_local883212642_0014.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:40,601 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [min] submitted hadoop job: job_local883212642_0014
2015-05-20 20:13:40,601 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [min] tracking url: http://localhost:8080/
2015-05-20 20:13:40,604 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt
2015-05-20 20:13:40,619 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:40,619 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:40,624 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:40,625 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(min)[by:[{1}:'char']]
2015-05-20 20:13:40,626 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 20:13:40,626 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 297, total: 409, max: 672
2015-05-20 20:13:40,626 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:40,627 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 20:13:40,627 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 297, total: 409, max: 672
2015-05-20 20:13:40,627 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:40,627 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 20:13:40,628 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 297, total: 409, max: 672
2015-05-20 20:13:40,628 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:40,628 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 20:13:40,628 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 297, total: 409, max: 672
2015-05-20 20:13:40,628 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:40,637 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 20:13:40,637 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 20:13:40,641 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(min)[by:[{1}:'char']]
2015-05-20 20:13:40,641 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'min']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/minby"]
2015-05-20 20:13:40,669 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/minby/_temporary
2015-05-20 20:13:40,712 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/assemblyhelpersplatform/minby
2015-05-20 20:13:40,724 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:13:40,724 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:13:40,738 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [sum] starting
2015-05-20 20:13:40,738 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [sum] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:40,738 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [sum] sink: Hfs["TextDelimited[['char', 'sum']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/sum"]
2015-05-20 20:13:40,738 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [sum] parallel execution is enabled: false
2015-05-20 20:13:40,738 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [sum] starting jobs: 1
2015-05-20 20:13:40,738 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [sum] allocating threads: 1
2015-05-20 20:13:40,739 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [sum] starting step: (1/1) ...semblyhelpersplatform/sum
2015-05-20 20:13:40,795 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi2108872344/.staging/job_local2108872344_0015/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:40,796 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi2108872344/.staging/job_local2108872344_0015/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:40,821 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local2108872344_0015/job_local2108872344_0015.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:40,821 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local2108872344_0015/job_local2108872344_0015.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:40,822 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [sum] submitted hadoop job: job_local2108872344_0015
2015-05-20 20:13:40,822 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [sum] tracking url: http://localhost:8080/
2015-05-20 20:13:40,825 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt
2015-05-20 20:13:40,842 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:40,842 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:40,847 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:40,847 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(sum)[by:[{1}:'char']]
2015-05-20 20:13:40,849 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 20:13:40,849 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 297, total: 409, max: 672
2015-05-20 20:13:40,849 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:40,850 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 20:13:40,850 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 297, total: 409, max: 672
2015-05-20 20:13:40,850 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:40,850 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 20:13:40,850 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 297, total: 409, max: 672
2015-05-20 20:13:40,850 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:40,851 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 20:13:40,851 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 297, total: 409, max: 672
2015-05-20 20:13:40,851 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:40,858 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 20:13:40,859 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 20:13:40,863 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(sum)[by:[{1}:'char']]
2015-05-20 20:13:40,863 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'sum']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/sum"]
2015-05-20 20:13:40,891 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/sum/_temporary
2015-05-20 20:13:40,930 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/assemblyhelpersplatform/sum
2015-05-20 20:13:40,942 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:13:40,942 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:13:40,955 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [sum-lhs+sum-rhs] starting
2015-05-20 20:13:40,955 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [sum-lhs+sum-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt"]
2015-05-20 20:13:40,955 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [sum-lhs+sum-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:40,956 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [sum-lhs+sum-rhs] sink: Hfs["TextDelimited[['char', 'sum']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/mergesum"]
2015-05-20 20:13:40,956 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [sum-lhs+sum-rhs] parallel execution is enabled: false
2015-05-20 20:13:40,956 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [sum-lhs+sum-rhs] starting jobs: 1
2015-05-20 20:13:40,956 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [sum-lhs+sum-rhs] allocating threads: 1
2015-05-20 20:13:40,956 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [sum-lhs+sum-rhs] starting step: (1/1) ...yhelpersplatform/mergesum
2015-05-20 20:13:41,011 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi185970902/.staging/job_local185970902_0016/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:41,013 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi185970902/.staging/job_local185970902_0016/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:41,038 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local185970902_0016/job_local185970902_0016.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:41,038 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local185970902_0016/job_local185970902_0016.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:41,038 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [sum-lhs+sum-rhs] submitted hadoop job: job_local185970902_0016
2015-05-20 20:13:41,039 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [sum-lhs+sum-rhs] tracking url: http://localhost:8080/
2015-05-20 20:13:41,041 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt
2015-05-20 20:13:41,056 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:41,056 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:41,062 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:41,062 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(sum-lhs+sum-rhs)[by: sum-lhs:[{1}:'char'] sum-rhs:[{1}:'char']]
2015-05-20 20:13:41,063 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 20:13:41,064 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 297, total: 409, max: 672
2015-05-20 20:13:41,064 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:41,064 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 20:13:41,064 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 297, total: 409, max: 672
2015-05-20 20:13:41,064 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:41,065 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 20:13:41,065 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 297, total: 409, max: 672
2015-05-20 20:13:41,065 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:41,065 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 20:13:41,065 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 297, total: 409, max: 672
2015-05-20 20:13:41,065 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:41,071 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt
2015-05-20 20:13:41,084 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:41,084 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:41,089 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt"]
2015-05-20 20:13:41,089 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(sum-lhs+sum-rhs)[by: sum-lhs:[{1}:'char'] sum-rhs:[{1}:'char']]
2015-05-20 20:13:41,091 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 20:13:41,091 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 195, total: 409, max: 672
2015-05-20 20:13:41,091 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:41,092 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 20:13:41,092 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 195, total: 409, max: 672
2015-05-20 20:13:41,092 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:41,092 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 20:13:41,093 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 195, total: 409, max: 672
2015-05-20 20:13:41,093 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:41,093 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 20:13:41,093 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 195, total: 409, max: 672
2015-05-20 20:13:41,093 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 60% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:41,102 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 20:13:41,102 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 20:13:41,107 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(sum-lhs+sum-rhs)[by: sum-lhs:[{1}:'char'] sum-rhs:[{1}:'char']]
2015-05-20 20:13:41,107 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'sum']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/mergesum"]
2015-05-20 20:13:41,138 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/mergesum/_temporary
2015-05-20 20:13:41,177 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/assemblyhelpersplatform/mergesum
2015-05-20 20:13:41,188 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:13:41,189 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:13:41,197 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] starting
2015-05-20 20:13:41,198 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-05-20 20:13:41,198 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] sink: Hfs["TextLine[['num']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/discardnarrow"]
2015-05-20 20:13:41,198 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] parallel execution is enabled: false
2015-05-20 20:13:41,198 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] starting jobs: 1
2015-05-20 20:13:41,198 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] allocating threads: 1
2015-05-20 20:13:41,198 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [shape] starting step: (1/1) ...ersplatform/discardnarrow
2015-05-20 20:13:41,254 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi1037589862/.staging/job_local1037589862_0017/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:41,255 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi1037589862/.staging/job_local1037589862_0017/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:41,280 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local1037589862_0017/job_local1037589862_0017.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:41,280 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local1037589862_0017/job_local1037589862_0017.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:41,281 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [shape] submitted hadoop job: job_local1037589862_0017
2015-05-20 20:13:41,281 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [shape] tracking url: http://localhost:8080/
2015-05-20 20:13:41,283 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt
2015-05-20 20:13:41,288 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:41,289 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:41,292 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-05-20 20:13:41,292 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['num']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/discardnarrow"]
2015-05-20 20:13:41,306 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/discardnarrow/_temporary
2015-05-20 20:13:41,335 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/assemblyhelpersplatform/discardnarrow
2015-05-20 20:13:41,350 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:13:41,350 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:13:41,365 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] starting
2015-05-20 20:13:41,365 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt"]
2015-05-20 20:13:41,365 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:41,365 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/multimerge+true478"]
2015-05-20 20:13:41,366 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] parallel execution is enabled: false
2015-05-20 20:13:41,366 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] starting jobs: 1
2015-05-20 20:13:41,366 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] allocating threads: 1
2015-05-20 20:13:41,366 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [name] starting step: (1/1) ...atform/multimerge+true478
2015-05-20 20:13:41,422 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi487772808/.staging/job_local487772808_0018/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:41,423 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi487772808/.staging/job_local487772808_0018/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:41,447 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local487772808_0018/job_local487772808_0018.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:41,447 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local487772808_0018/job_local487772808_0018.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:41,448 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [name] submitted hadoop job: job_local487772808_0018
2015-05-20 20:13:41,448 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [name] tracking url: http://localhost:8080/
2015-05-20 20:13:41,451 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt
2015-05-20 20:13:41,463 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:41,463 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:41,469 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:41,469 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2015-05-20 20:13:41,470 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 20:13:41,470 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 224, total: 410, max: 672
2015-05-20 20:13:41,470 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:41,471 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 20:13:41,471 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 224, total: 410, max: 672
2015-05-20 20:13:41,471 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:41,471 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 20:13:41,472 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 224, total: 410, max: 672
2015-05-20 20:13:41,472 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:41,472 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 20:13:41,472 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 224, total: 410, max: 672
2015-05-20 20:13:41,472 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:41,478 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt
2015-05-20 20:13:41,493 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:41,493 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:41,499 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt"]
2015-05-20 20:13:41,499 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2015-05-20 20:13:41,501 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 20:13:41,501 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 296, total: 410, max: 672
2015-05-20 20:13:41,501 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:41,502 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 20:13:41,502 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 296, total: 410, max: 672
2015-05-20 20:13:41,502 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:41,503 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 20:13:41,503 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 296, total: 410, max: 672
2015-05-20 20:13:41,503 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:41,503 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 20:13:41,503 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 296, total: 410, max: 672
2015-05-20 20:13:41,504 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 61% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:41,513 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 20:13:41,513 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 20:13:41,520 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(name)[by:[{1}:'char']]
2015-05-20 20:13:41,520 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/multimerge+true478"]
2015-05-20 20:13:41,551 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/multimerge+true478/_temporary
2015-05-20 20:13:41,588 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/assemblyhelpersplatform/multimerge+true478
2015-05-20 20:13:41,597 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:13:41,598 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:13:41,604 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] starting
2015-05-20 20:13:41,604 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-05-20 20:13:41,604 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] sink: Hfs["TextLine[['line']->['item', 'element']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/rename"]
2015-05-20 20:13:41,604 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] parallel execution is enabled: false
2015-05-20 20:13:41,604 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] starting jobs: 1
2015-05-20 20:13:41,604 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] allocating threads: 1
2015-05-20 20:13:41,605 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [shape] starting step: (1/1) ...blyhelpersplatform/rename
2015-05-20 20:13:41,658 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi1009610077/.staging/job_local1009610077_0019/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:41,659 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi1009610077/.staging/job_local1009610077_0019/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:41,685 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local1009610077_0019/job_local1009610077_0019.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:41,685 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local1009610077_0019/job_local1009610077_0019.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:41,686 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [shape] submitted hadoop job: job_local1009610077_0019
2015-05-20 20:13:41,686 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [shape] tracking url: http://localhost:8080/
2015-05-20 20:13:41,688 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt
2015-05-20 20:13:41,693 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:41,693 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:41,696 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-05-20 20:13:41,696 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['line']->['item', 'element']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/rename"]
2015-05-20 20:13:41,711 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/rename/_temporary
2015-05-20 20:13:41,731 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/assemblyhelpersplatform/rename
2015-05-20 20:13:41,743 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:13:41,744 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:13:41,758 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] starting
2015-05-20 20:13:41,758 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt"]
2015-05-20 20:13:41,758 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:41,758 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/multimerge+true477"]
2015-05-20 20:13:41,758 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] parallel execution is enabled: false
2015-05-20 20:13:41,758 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] starting jobs: 1
2015-05-20 20:13:41,758 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] allocating threads: 1
2015-05-20 20:13:41,759 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [name] starting step: (1/1) ...atform/multimerge+true477
2015-05-20 20:13:41,814 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi1489452323/.staging/job_local1489452323_0020/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:41,815 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi1489452323/.staging/job_local1489452323_0020/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:41,841 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local1489452323_0020/job_local1489452323_0020.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:41,841 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local1489452323_0020/job_local1489452323_0020.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:41,842 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [name] submitted hadoop job: job_local1489452323_0020
2015-05-20 20:13:41,842 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [name] tracking url: http://localhost:8080/
2015-05-20 20:13:41,844 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt
2015-05-20 20:13:41,860 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:41,860 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:41,867 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:41,867 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2015-05-20 20:13:41,868 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 20:13:41,868 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 279, total: 394, max: 672
2015-05-20 20:13:41,868 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 58% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:41,869 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 20:13:41,869 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 279, total: 394, max: 672
2015-05-20 20:13:41,869 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 58% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:41,869 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 20:13:41,869 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 279, total: 394, max: 672
2015-05-20 20:13:41,869 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 58% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:41,870 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 20:13:41,870 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 279, total: 394, max: 672
2015-05-20 20:13:41,870 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 58% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:41,875 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt
2015-05-20 20:13:41,888 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:41,888 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:41,894 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt"]
2015-05-20 20:13:41,894 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2015-05-20 20:13:41,896 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 20:13:41,896 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 177, total: 394, max: 672
2015-05-20 20:13:41,896 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 58% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:41,897 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 20:13:41,897 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 177, total: 394, max: 672
2015-05-20 20:13:41,897 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 58% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:41,898 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 20:13:41,898 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 177, total: 394, max: 672
2015-05-20 20:13:41,898 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 58% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:41,898 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 20:13:41,898 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 177, total: 394, max: 672
2015-05-20 20:13:41,898 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 58% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:41,907 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 20:13:41,907 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 20:13:41,914 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(name)[by:[{1}:'char']]
2015-05-20 20:13:41,914 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/multimerge+true477"]
2015-05-20 20:13:41,939 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/multimerge+true477/_temporary
2015-05-20 20:13:41,996 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/assemblyhelpersplatform/multimerge+true477
2015-05-20 20:13:42,011 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:13:42,011 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:13:42,033 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [second] starting
2015-05-20 20:13:42,033 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [second] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:42,033 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [second] sink: Hfs["TextDelimited[['char', 'count']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/samesourcemergecount"]
2015-05-20 20:13:42,033 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [second] parallel execution is enabled: false
2015-05-20 20:13:42,033 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [second] starting jobs: 2
2015-05-20 20:13:42,033 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [second] allocating threads: 1
2015-05-20 20:13:42,034 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [second] starting step: (1/2)
2015-05-20 20:13:42,088 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi111572342/.staging/job_local111572342_0021/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:42,089 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi111572342/.staging/job_local111572342_0021/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:42,114 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local111572342_0021/job_local111572342_0021.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:42,114 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local111572342_0021/job_local111572342_0021.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:42,115 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [second] submitted hadoop job: job_local111572342_0021
2015-05-20 20:13:42,115 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [second] tracking url: http://localhost:8080/
2015-05-20 20:13:42,118 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt
2015-05-20 20:13:42,130 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:42,130 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:42,134 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:42,135 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(first)[by:[{1}:'char']]
2015-05-20 20:13:42,137 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 20:13:42,137 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 233, total: 383, max: 672
2015-05-20 20:13:42,137 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 56% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:42,137 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 20:13:42,137 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 233, total: 383, max: 672
2015-05-20 20:13:42,138 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 56% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:42,138 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 20:13:42,138 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 233, total: 383, max: 672
2015-05-20 20:13:42,138 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 56% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:42,138 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 20:13:42,139 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 233, total: 383, max: 672
2015-05-20 20:13:42,139 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 56% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:42,145 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 20:13:42,145 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 20:13:42,149 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(first)[by:[{1}:'char']]
2015-05-20 20:13:42,149 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: TempHfs["SequenceFile[['char', 'count']]"][2862508208/first/]
2015-05-20 20:13:42,176 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [second] starting step: (2/2) ...form/samesourcemergecount
2015-05-20 20:13:42,238 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi849244521/.staging/job_local849244521_0022/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:42,239 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi849244521/.staging/job_local849244521_0022/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:42,263 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local849244521_0022/job_local849244521_0022.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:42,263 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local849244521_0022/job_local849244521_0022.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:42,264 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [second] submitted hadoop job: job_local849244521_0022
2015-05-20 20:13:42,264 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [second] tracking url: http://localhost:8080/
2015-05-20 20:13:42,267 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-soberoi/2862508208_first_1DC41F90A5584D399F8946BADADD93D5/part-00000
2015-05-20 20:13:42,281 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:42,282 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:42,286 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][2862508208/first/]
2015-05-20 20:13:42,286 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(second)[by:[{1}:'char']]
2015-05-20 20:13:42,287 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 20:13:42,287 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 269, total: 384, max: 672
2015-05-20 20:13:42,287 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 57% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:42,288 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 20:13:42,288 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 269, total: 384, max: 672
2015-05-20 20:13:42,288 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 57% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:42,294 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 20:13:42,294 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 20:13:42,298 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(second)[by:[{1}:'char']]
2015-05-20 20:13:42,299 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'count']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/samesourcemergecount"]
2015-05-20 20:13:42,324 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/samesourcemergecount/_temporary
2015-05-20 20:13:42,363 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/assemblyhelpersplatform/samesourcemergecount
2015-05-20 20:13:42,374 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:13:42,374 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:13:42,382 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [average] starting
2015-05-20 20:13:42,382 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [average] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:42,382 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [average] sink: Hfs["TextDelimited[['char', 'average']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/average"]
2015-05-20 20:13:42,383 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [average] parallel execution is enabled: false
2015-05-20 20:13:42,383 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [average] starting jobs: 1
2015-05-20 20:13:42,383 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [average] allocating threads: 1
2015-05-20 20:13:42,383 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [average] starting step: (1/1) ...lyhelpersplatform/average
2015-05-20 20:13:42,443 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi1140484867/.staging/job_local1140484867_0023/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:42,445 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi1140484867/.staging/job_local1140484867_0023/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:42,480 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local1140484867_0023/job_local1140484867_0023.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:42,480 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local1140484867_0023/job_local1140484867_0023.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:42,481 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [average] submitted hadoop job: job_local1140484867_0023
2015-05-20 20:13:42,481 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [average] tracking url: http://localhost:8080/
2015-05-20 20:13:42,484 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt
2015-05-20 20:13:42,497 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:42,498 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:42,501 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:42,501 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(average)[by:[{1}:'char']]
2015-05-20 20:13:42,502 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 20:13:42,502 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 254, total: 369, max: 672
2015-05-20 20:13:42,502 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 54% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:42,503 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 20:13:42,503 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 253, total: 369, max: 672
2015-05-20 20:13:42,503 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 54% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:42,503 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 20:13:42,503 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 253, total: 369, max: 672
2015-05-20 20:13:42,503 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 54% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:42,504 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 20:13:42,504 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 253, total: 369, max: 672
2015-05-20 20:13:42,504 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 54% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:42,511 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 20:13:42,511 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 20:13:42,514 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(average)[by:[{1}:'char']]
2015-05-20 20:13:42,514 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'average']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/average"]
2015-05-20 20:13:42,540 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/average/_temporary
2015-05-20 20:13:42,585 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/assemblyhelpersplatform/average
2015-05-20 20:13:42,595 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:13:42,595 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:13:42,603 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] starting
2015-05-20 20:13:42,604 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:42,604 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] sink: Hfs["TextDelimited[['char', 'max']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/maxbynullsafety"]
2015-05-20 20:13:42,604 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] parallel execution is enabled: false
2015-05-20 20:13:42,604 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] starting jobs: 1
2015-05-20 20:13:42,604 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] allocating threads: 1
2015-05-20 20:13:42,604 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [max] starting step: (1/1) ...splatform/maxbynullsafety
2015-05-20 20:13:42,656 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi1267674161/.staging/job_local1267674161_0024/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:42,656 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi1267674161/.staging/job_local1267674161_0024/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:42,684 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local1267674161_0024/job_local1267674161_0024.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:42,685 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local1267674161_0024/job_local1267674161_0024.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:42,686 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [max] submitted hadoop job: job_local1267674161_0024
2015-05-20 20:13:42,686 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [max] tracking url: http://localhost:8080/
2015-05-20 20:13:42,689 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt
2015-05-20 20:13:42,738 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:42,738 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:42,742 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:42,743 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(max)[by:[{1}:'char']]
2015-05-20 20:13:42,744 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 20:13:42,744 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 103, total: 369, max: 672
2015-05-20 20:13:42,744 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 54% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:42,745 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 20:13:42,745 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 102, total: 369, max: 672
2015-05-20 20:13:42,745 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 54% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:42,745 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 20:13:42,745 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 102, total: 369, max: 672
2015-05-20 20:13:42,746 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 54% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:42,746 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 20:13:42,746 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 102, total: 369, max: 672
2015-05-20 20:13:42,746 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 54% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:42,752 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 20:13:42,752 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 20:13:42,756 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(max)[by:[{1}:'char']]
2015-05-20 20:13:42,756 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'max']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/maxbynullsafety"]
2015-05-20 20:13:42,780 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/maxbynullsafety/_temporary
2015-05-20 20:13:42,822 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/assemblyhelpersplatform/maxbynullsafety
2015-05-20 20:13:42,832 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:13:42,833 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:13:42,840 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [sum] starting
2015-05-20 20:13:42,840 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [sum] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:42,840 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [sum] sink: Hfs["TextDelimited[['char', 'sum']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/sumnulls"]
2015-05-20 20:13:42,840 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [sum] parallel execution is enabled: false
2015-05-20 20:13:42,840 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [sum] starting jobs: 1
2015-05-20 20:13:42,840 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [sum] allocating threads: 1
2015-05-20 20:13:42,841 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [sum] starting step: (1/1) ...yhelpersplatform/sumnulls
2015-05-20 20:13:42,894 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi200403809/.staging/job_local200403809_0025/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:42,895 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi200403809/.staging/job_local200403809_0025/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:42,923 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local200403809_0025/job_local200403809_0025.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:42,923 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local200403809_0025/job_local200403809_0025.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:42,924 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [sum] submitted hadoop job: job_local200403809_0025
2015-05-20 20:13:42,924 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [sum] tracking url: http://localhost:8080/
2015-05-20 20:13:42,927 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt
2015-05-20 20:13:42,938 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:42,938 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:42,942 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:42,942 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(sum)[by:[{1}:'char']]
2015-05-20 20:13:42,946 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 20:13:42,947 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 143, total: 363, max: 672
2015-05-20 20:13:42,947 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 54% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:42,947 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 20:13:42,947 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 143, total: 363, max: 672
2015-05-20 20:13:42,947 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 54% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:42,948 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 20:13:42,948 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 143, total: 363, max: 672
2015-05-20 20:13:42,948 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 54% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:42,948 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 20:13:42,948 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 143, total: 363, max: 672
2015-05-20 20:13:42,948 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 54% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:42,955 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 20:13:42,955 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 20:13:42,959 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(sum)[by:[{1}:'char']]
2015-05-20 20:13:42,960 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'sum']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/sumnulls"]
2015-05-20 20:13:42,986 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/sumnulls/_temporary
2015-05-20 20:13:43,024 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/assemblyhelpersplatform/sumnulls
2015-05-20 20:13:43,032 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:13:43,033 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:13:43,039 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] starting
2015-05-20 20:13:43,039 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:43,040 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] sink: Hfs["TextDelimited[['count']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/countall"]
2015-05-20 20:13:43,040 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] parallel execution is enabled: false
2015-05-20 20:13:43,040 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] starting jobs: 1
2015-05-20 20:13:43,040 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] allocating threads: 1
2015-05-20 20:13:43,040 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count] starting step: (1/1) ...yhelpersplatform/countall
2015-05-20 20:13:43,093 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi200168467/.staging/job_local200168467_0026/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:43,094 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi200168467/.staging/job_local200168467_0026/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:43,118 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local200168467_0026/job_local200168467_0026.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:43,118 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local200168467_0026/job_local200168467_0026.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:43,119 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count] submitted hadoop job: job_local200168467_0026
2015-05-20 20:13:43,119 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count] tracking url: http://localhost:8080/
2015-05-20 20:13:43,122 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt
2015-05-20 20:13:43,166 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:43,167 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:43,170 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:43,170 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(count)[by:[{?}:NONE]]
2015-05-20 20:13:43,177 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 20:13:43,178 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 20:13:43,180 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(count)[by:[{?}:NONE]]
2015-05-20 20:13:43,181 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['count']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/countall"]
2015-05-20 20:13:43,204 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/countall/_temporary
2015-05-20 20:13:43,242 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/assemblyhelpersplatform/countall
2015-05-20 20:13:43,252 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:13:43,252 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:13:43,261 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] starting
2015-05-20 20:13:43,261 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:43,261 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average', 'average2', 'first']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/multi"]
2015-05-20 20:13:43,261 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] parallel execution is enabled: false
2015-05-20 20:13:43,262 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] starting jobs: 1
2015-05-20 20:13:43,262 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] allocating threads: 1
2015-05-20 20:13:43,262 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [name] starting step: (1/1) ...mblyhelpersplatform/multi
2015-05-20 20:13:43,317 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi1209967577/.staging/job_local1209967577_0027/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:43,318 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi1209967577/.staging/job_local1209967577_0027/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:43,344 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local1209967577_0027/job_local1209967577_0027.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:43,344 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local1209967577_0027/job_local1209967577_0027.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:43,345 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [name] submitted hadoop job: job_local1209967577_0027
2015-05-20 20:13:43,345 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [name] tracking url: http://localhost:8080/
2015-05-20 20:13:43,348 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt
2015-05-20 20:13:43,360 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:43,360 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:43,364 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:43,364 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2015-05-20 20:13:43,365 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 20:13:43,365 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 126, total: 457, max: 672
2015-05-20 20:13:43,365 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 68% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:43,366 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 20:13:43,366 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 126, total: 457, max: 672
2015-05-20 20:13:43,366 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 68% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:43,367 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 20:13:43,367 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 126, total: 457, max: 672
2015-05-20 20:13:43,367 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 68% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:43,367 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 20:13:43,367 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 126, total: 457, max: 672
2015-05-20 20:13:43,367 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 68% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:43,374 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 20:13:43,374 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 20:13:43,378 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(name)[by:[{1}:'char']]
2015-05-20 20:13:43,378 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average', 'average2', 'first']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/multi"]
2015-05-20 20:13:43,408 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/multi/_temporary
2015-05-20 20:13:43,447 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/assemblyhelpersplatform/multi
2015-05-20 20:13:43,456 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:13:43,456 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:13:43,464 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] starting
2015-05-20 20:13:43,465 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-05-20 20:13:43,465 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] sink: Hfs["TextLine[['num']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/retainnarrow"]
2015-05-20 20:13:43,465 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] parallel execution is enabled: false
2015-05-20 20:13:43,465 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] starting jobs: 1
2015-05-20 20:13:43,465 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] allocating threads: 1
2015-05-20 20:13:43,465 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [shape] starting step: (1/1) ...persplatform/retainnarrow
2015-05-20 20:13:43,518 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi1937733773/.staging/job_local1937733773_0028/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:43,518 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi1937733773/.staging/job_local1937733773_0028/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:43,541 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local1937733773_0028/job_local1937733773_0028.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:43,541 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local1937733773_0028/job_local1937733773_0028.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:43,542 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [shape] submitted hadoop job: job_local1937733773_0028
2015-05-20 20:13:43,542 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [shape] tracking url: http://localhost:8080/
2015-05-20 20:13:43,545 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt
2015-05-20 20:13:43,550 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:43,550 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:43,552 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-05-20 20:13:43,552 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['num']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/retainnarrow"]
2015-05-20 20:13:43,567 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/retainnarrow/_temporary
2015-05-20 20:13:43,586 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/assemblyhelpersplatform/retainnarrow
2015-05-20 20:13:43,595 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:13:43,596 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:13:43,600 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] starting
2015-05-20 20:13:43,601 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-05-20 20:13:43,601 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] sink: Hfs["TextLine[['item']->['char', 'item']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/renamenarrow"]
2015-05-20 20:13:43,601 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] parallel execution is enabled: false
2015-05-20 20:13:43,601 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] starting jobs: 1
2015-05-20 20:13:43,601 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] allocating threads: 1
2015-05-20 20:13:43,601 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [shape] starting step: (1/1) ...persplatform/renamenarrow
2015-05-20 20:13:43,655 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi1302805626/.staging/job_local1302805626_0029/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:43,655 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi1302805626/.staging/job_local1302805626_0029/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:43,679 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local1302805626_0029/job_local1302805626_0029.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:43,679 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local1302805626_0029/job_local1302805626_0029.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:43,680 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [shape] submitted hadoop job: job_local1302805626_0029
2015-05-20 20:13:43,680 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [shape] tracking url: http://localhost:8080/
2015-05-20 20:13:43,683 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt
2015-05-20 20:13:43,687 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:43,688 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:43,690 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-05-20 20:13:43,690 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['item']->['char', 'item']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/renamenarrow"]
2015-05-20 20:13:43,704 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/renamenarrow/_temporary
2015-05-20 20:13:43,723 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/assemblyhelpersplatform/renamenarrow
2015-05-20 20:13:43,733 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:13:43,733 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:13:43,739 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [average] starting
2015-05-20 20:13:43,739 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [average] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:43,739 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [average] sink: Hfs["TextDelimited[['char', 'average']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/averagenull"]
2015-05-20 20:13:43,739 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [average] parallel execution is enabled: false
2015-05-20 20:13:43,739 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [average] starting jobs: 1
2015-05-20 20:13:43,739 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [average] allocating threads: 1
2015-05-20 20:13:43,740 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [average] starting step: (1/1) ...lpersplatform/averagenull
2015-05-20 20:13:43,794 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi1217640777/.staging/job_local1217640777_0030/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:43,795 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi1217640777/.staging/job_local1217640777_0030/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:43,818 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local1217640777_0030/job_local1217640777_0030.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:43,818 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local1217640777_0030/job_local1217640777_0030.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:43,819 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [average] submitted hadoop job: job_local1217640777_0030
2015-05-20 20:13:43,819 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [average] tracking url: http://localhost:8080/
2015-05-20 20:13:43,822 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt
2015-05-20 20:13:43,833 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:43,833 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:43,837 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:43,837 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(average)[by:[{1}:'char']]
2015-05-20 20:13:43,839 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 20:13:43,839 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 64, total: 450, max: 672
2015-05-20 20:13:43,839 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 66% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:43,840 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 20:13:43,840 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 64, total: 450, max: 672
2015-05-20 20:13:43,840 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 66% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:43,841 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 20:13:43,841 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 64, total: 450, max: 672
2015-05-20 20:13:43,841 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 66% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:43,841 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 20:13:43,841 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 64, total: 450, max: 672
2015-05-20 20:13:43,841 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 66% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:43,848 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 20:13:43,848 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 20:13:43,852 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(average)[by:[{1}:'char']]
2015-05-20 20:13:43,852 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'average']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/averagenull"]
2015-05-20 20:13:43,877 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/averagenull/_temporary
2015-05-20 20:13:43,922 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/assemblyhelpersplatform/averagenull
2015-05-20 20:13:43,936 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:13:43,936 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:13:43,943 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [coerce] starting
2015-05-20 20:13:43,943 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [coerce] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-05-20 20:13:43,943 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [coerce] sink: Hfs["TextLine[['line']->['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/coerce"]
2015-05-20 20:13:43,943 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [coerce] parallel execution is enabled: false
2015-05-20 20:13:43,943 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [coerce] starting jobs: 1
2015-05-20 20:13:43,943 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [coerce] allocating threads: 1
2015-05-20 20:13:43,944 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [coerce] starting step: (1/1) ...blyhelpersplatform/coerce
2015-05-20 20:13:44,005 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi178260384/.staging/job_local178260384_0031/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:44,006 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi178260384/.staging/job_local178260384_0031/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:44,030 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local178260384_0031/job_local178260384_0031.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:44,031 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local178260384_0031/job_local178260384_0031.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:44,032 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [coerce] submitted hadoop job: job_local178260384_0031
2015-05-20 20:13:44,032 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [coerce] tracking url: http://localhost:8080/
2015-05-20 20:13:44,034 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt
2015-05-20 20:13:44,040 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:44,040 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:44,042 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-05-20 20:13:44,042 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['line']->['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/coerce"]
2015-05-20 20:13:44,058 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/coerce/_temporary
2015-05-20 20:13:44,083 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/assemblyhelpersplatform/coerce
2015-05-20 20:13:44,095 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:13:44,096 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:13:44,102 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [first] starting
2015-05-20 20:13:44,103 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [first] source: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs+rhs-cross-rev.txt"]
2015-05-20 20:13:44,103 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [first] sink: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/firstnfieldswithoutcomparator"]
2015-05-20 20:13:44,103 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [first] parallel execution is enabled: false
2015-05-20 20:13:44,103 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [first] starting jobs: 1
2015-05-20 20:13:44,103 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [first] allocating threads: 1
2015-05-20 20:13:44,103 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [first] starting step: (1/1) ...tnfieldswithoutcomparator
2015-05-20 20:13:44,174 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi185469197/.staging/job_local185469197_0032/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:44,174 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi185469197/.staging/job_local185469197_0032/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:44,211 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local185469197_0032/job_local185469197_0032.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:44,211 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local185469197_0032/job_local185469197_0032.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:44,212 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [first] submitted hadoop job: job_local185469197_0032
2015-05-20 20:13:44,212 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [first] tracking url: http://localhost:8080/
2015-05-20 20:13:44,215 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs+rhs-cross-rev.txt
2015-05-20 20:13:44,266 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:44,266 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:44,269 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs+rhs-cross-rev.txt"]
2015-05-20 20:13:44,269 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(first)[by:[{1}:'num']]
2015-05-20 20:13:44,271 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 20:13:44,271 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 142, total: 544, max: 672
2015-05-20 20:13:44,272 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 20:13:44,272 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 141, total: 544, max: 672
2015-05-20 20:13:44,278 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 20:13:44,279 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 20:13:44,281 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(first)[by:[{1}:'num']]
2015-05-20 20:13:44,281 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/firstnfieldswithoutcomparator"]
2015-05-20 20:13:44,306 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/firstnfieldswithoutcomparator/_temporary
2015-05-20 20:13:44,328 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/assemblyhelpersplatform/firstnfieldswithoutcomparator
2015-05-20 20:13:44,343 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:13:44,343 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:13:44,353 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] starting
2015-05-20 20:13:44,353 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt"]
2015-05-20 20:13:44,354 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:44,354 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/multimerge+false478"]
2015-05-20 20:13:44,354 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] parallel execution is enabled: false
2015-05-20 20:13:44,354 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] starting jobs: 1
2015-05-20 20:13:44,354 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] allocating threads: 1
2015-05-20 20:13:44,354 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [name] starting step: (1/1) ...tform/multimerge+false478
2015-05-20 20:13:44,405 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi530150096/.staging/job_local530150096_0033/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:44,405 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi530150096/.staging/job_local530150096_0033/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:44,431 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local530150096_0033/job_local530150096_0033.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:44,431 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local530150096_0033/job_local530150096_0033.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:44,432 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [name] submitted hadoop job: job_local530150096_0033
2015-05-20 20:13:44,432 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [name] tracking url: http://localhost:8080/
2015-05-20 20:13:44,434 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt
2015-05-20 20:13:44,484 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:44,484 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:44,488 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:44,489 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2015-05-20 20:13:44,489 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 20:13:44,490 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 94, total: 645, max: 672
2015-05-20 20:13:44,490 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 20:13:44,490 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 94, total: 645, max: 672
2015-05-20 20:13:44,491 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 20:13:44,491 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 94, total: 645, max: 672
2015-05-20 20:13:44,491 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 20:13:44,491 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 94, total: 645, max: 672
2015-05-20 20:13:44,496 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt
2015-05-20 20:13:44,512 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:44,512 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:44,517 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt"]
2015-05-20 20:13:44,517 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2015-05-20 20:13:44,519 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 20:13:44,520 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 151, total: 672, max: 672
2015-05-20 20:13:44,520 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 20:13:44,520 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 151, total: 672, max: 672
2015-05-20 20:13:44,521 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 20:13:44,521 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 151, total: 672, max: 672
2015-05-20 20:13:44,521 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 20:13:44,521 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 151, total: 672, max: 672
2015-05-20 20:13:44,530 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 20:13:44,530 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 20:13:44,534 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2015-05-20 20:13:44,534 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/multimerge+false478"]
2015-05-20 20:13:44,555 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/multimerge+false478/_temporary
2015-05-20 20:13:44,595 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/assemblyhelpersplatform/multimerge+false478
2015-05-20 20:13:44,606 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:13:44,606 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:13:44,633 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count-lhs*source*count...] starting
2015-05-20 20:13:44,633 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count-lhs*source*count...] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:44,634 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count-lhs*source*count...] sink: Hfs["TextDelimited[['char', 'count']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/samesourcemergethreeway"]
2015-05-20 20:13:44,634 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count-lhs*source*count...] parallel execution is enabled: false
2015-05-20 20:13:44,634 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count-lhs*source*count...] starting jobs: 5
2015-05-20 20:13:44,634 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count-lhs*source*count...] allocating threads: 1
2015-05-20 20:13:44,634 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count-lhs*source*count...] starting step: (1/5)
2015-05-20 20:13:44,687 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi1281674497/.staging/job_local1281674497_0034/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:44,688 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi1281674497/.staging/job_local1281674497_0034/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:44,712 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local1281674497_0034/job_local1281674497_0034.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:44,712 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local1281674497_0034/job_local1281674497_0034.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:44,713 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count-lhs*source*count...] submitted hadoop job: job_local1281674497_0034
2015-05-20 20:13:44,713 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2015-05-20 20:13:44,715 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt
2015-05-20 20:13:44,731 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:44,731 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:44,734 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:44,734 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(source)[by:[{1}:'char']]
2015-05-20 20:13:44,735 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 20:13:44,735 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 185, total: 705, max: 705
2015-05-20 20:13:44,736 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 20:13:44,736 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 185, total: 705, max: 705
2015-05-20 20:13:44,736 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 20:13:44,736 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 185, total: 705, max: 705
2015-05-20 20:13:44,736 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 20:13:44,736 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 185, total: 705, max: 705
2015-05-20 20:13:44,742 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 20:13:44,743 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 20:13:44,745 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(source)[by:[{1}:'char']]
2015-05-20 20:13:44,745 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: TempHfs["SequenceFile[['char', 'count']]"][7392911583/source/]
2015-05-20 20:13:44,771 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count-lhs*source*count...] starting step: (3/5)
2015-05-20 20:13:44,837 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi1638777823/.staging/job_local1638777823_0035/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:44,838 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi1638777823/.staging/job_local1638777823_0035/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:44,860 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local1638777823_0035/job_local1638777823_0035.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:44,861 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local1638777823_0035/job_local1638777823_0035.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:44,861 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count-lhs*source*count...] submitted hadoop job: job_local1638777823_0035
2015-05-20 20:13:44,862 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2015-05-20 20:13:44,864 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-soberoi/7392911583_source_6EF1B0ED16D745D394DEB33E2EBC85CF/part-00000
2015-05-20 20:13:44,879 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:44,879 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:44,882 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][7392911583/source/]
2015-05-20 20:13:44,882 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(count-lhs)[by:[{1}:'char']]
2015-05-20 20:13:44,883 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 20:13:44,883 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 186, total: 705, max: 705
2015-05-20 20:13:44,883 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 20:13:44,883 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 186, total: 705, max: 705
2015-05-20 20:13:44,890 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 20:13:44,890 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 20:13:44,892 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(count-lhs)[by:[{1}:'char']]
2015-05-20 20:13:44,893 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: TempHfs["SequenceFile[['char', 'count']]"][5758621986/count-lhs/]
2015-05-20 20:13:44,909 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count-lhs*source*count...] starting step: (4/5)
2015-05-20 20:13:44,977 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi637465603/.staging/job_local637465603_0036/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:44,978 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi637465603/.staging/job_local637465603_0036/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:45,002 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local637465603_0036/job_local637465603_0036.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:45,003 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local637465603_0036/job_local637465603_0036.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:45,003 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count-lhs*source*count...] submitted hadoop job: job_local637465603_0036
2015-05-20 20:13:45,003 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2015-05-20 20:13:45,006 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-soberoi/7392911583_source_6EF1B0ED16D745D394DEB33E2EBC85CF/part-00000
2015-05-20 20:13:45,020 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:45,021 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:45,023 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][7392911583/source/]
2015-05-20 20:13:45,023 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(count-rhs)[by:[{1}:'char']]
2015-05-20 20:13:45,024 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 20:13:45,024 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 229, total: 748, max: 748
2015-05-20 20:13:45,024 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 20:13:45,024 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 229, total: 748, max: 748
2015-05-20 20:13:45,030 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 20:13:45,030 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 20:13:45,033 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(count-rhs)[by:[{1}:'char']]
2015-05-20 20:13:45,033 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: TempHfs["SequenceFile[['char', 'count']]"][4178388283/count-rhs/]
2015-05-20 20:13:45,051 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count-lhs*source*count...] starting step: (2/5)
2015-05-20 20:13:45,127 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi1102098566/.staging/job_local1102098566_0037/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:45,128 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi1102098566/.staging/job_local1102098566_0037/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:45,152 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local1102098566_0037/job_local1102098566_0037.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:45,152 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local1102098566_0037/job_local1102098566_0037.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:45,153 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count-lhs*source*count...] submitted hadoop job: job_local1102098566_0037
2015-05-20 20:13:45,153 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2015-05-20 20:13:45,156 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-soberoi/4178388283_count_rhs_D9C984675AEB4C7C9F19891DAD74A44C/part-00000
2015-05-20 20:13:45,171 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:45,172 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:45,175 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][4178388283/count-rhs/]
2015-05-20 20:13:45,175 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: CoGroup(source*count-rhs)[by: source:[{1}:'char'] count-rhs:[{1}:'char']]
2015-05-20 20:13:45,180 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-soberoi/7392911583_source_6EF1B0ED16D745D394DEB33E2EBC85CF/part-00000
2015-05-20 20:13:45,191 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:45,192 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:45,194 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][7392911583/source/]
2015-05-20 20:13:45,195 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: CoGroup(source*count-rhs)[by: source:[{1}:'char'] count-rhs:[{1}:'char']]
2015-05-20 20:13:45,202 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 20:13:45,202 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 20:13:45,205 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: CoGroup(source*count-rhs)[by: source:[{1}:'char'] count-rhs:[{1}:'char']]
2015-05-20 20:13:45,205 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: TempHfs["SequenceFile[['char', 'num', 'char2', 'count']]"][2764982228/source_count-rhs/]
2015-05-20 20:13:45,213 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-05-20 20:13:45,213 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2015-05-20 20:13:45,235 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count-lhs*source*count...] starting step: (5/5) ...m/samesourcemergethreeway
2015-05-20 20:13:45,311 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi1722783034/.staging/job_local1722783034_0038/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:45,312 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi1722783034/.staging/job_local1722783034_0038/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:45,347 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local1722783034_0038/job_local1722783034_0038.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:45,348 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local1722783034_0038/job_local1722783034_0038.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:45,348 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count-lhs*source*count...] submitted hadoop job: job_local1722783034_0038
2015-05-20 20:13:45,349 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2015-05-20 20:13:45,351 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-soberoi/2764982228_source_count_rhs_7A824C4200344930B3CD9E3DE2D294CC/part-00000
2015-05-20 20:13:45,363 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:45,363 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:45,366 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: TempHfs["SequenceFile[['char', 'num', 'char2', 'count']]"][2764982228/source_count-rhs/]
2015-05-20 20:13:45,366 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: CoGroup(count-lhs*source*count-rhs)[by: count-lhs:[{1}:'char'] source*count-rhs:[{1}:'char']]
2015-05-20 20:13:45,371 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-soberoi/5758621986_count_lhs_AFBE977C542348809B9C5A25457B612E/part-00000
2015-05-20 20:13:45,383 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:45,384 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:45,387 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][5758621986/count-lhs/]
2015-05-20 20:13:45,387 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: CoGroup(count-lhs*source*count-rhs)[by: count-lhs:[{1}:'char'] source*count-rhs:[{1}:'char']]
2015-05-20 20:13:45,394 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 20:13:45,395 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 20:13:45,398 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: CoGroup(count-lhs*source*count-rhs)[by: count-lhs:[{1}:'char'] source*count-rhs:[{1}:'char']]
2015-05-20 20:13:45,398 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'count']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/samesourcemergethreeway"]
2015-05-20 20:13:45,403 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-05-20 20:13:45,404 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2015-05-20 20:13:45,421 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/samesourcemergethreeway/_temporary
2015-05-20 20:13:45,460 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/assemblyhelpersplatform/samesourcemergethreeway
2015-05-20 20:13:45,470 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:13:45,471 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:13:45,479 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [lhs+rhs] starting
2015-05-20 20:13:45,479 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [lhs+rhs] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt"]
2015-05-20 20:13:45,479 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [lhs+rhs] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:45,479 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [lhs+rhs] sink: Hfs["TextLine[['item']->['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/uniquemerge-nondeterministic"]
2015-05-20 20:13:45,479 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [lhs+rhs] parallel execution is enabled: false
2015-05-20 20:13:45,480 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [lhs+rhs] starting jobs: 1
2015-05-20 20:13:45,480 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [lhs+rhs] allocating threads: 1
2015-05-20 20:13:45,480 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [lhs+rhs] starting step: (1/1) ...quemerge-nondeterministic
2015-05-20 20:13:45,536 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi509786145/.staging/job_local509786145_0039/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:45,537 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi509786145/.staging/job_local509786145_0039/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:45,560 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local509786145_0039/job_local509786145_0039.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:45,560 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local509786145_0039/job_local509786145_0039.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:45,561 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [lhs+rhs] submitted hadoop job: job_local509786145_0039
2015-05-20 20:13:45,561 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [lhs+rhs] tracking url: http://localhost:8080/
2015-05-20 20:13:45,564 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt
2015-05-20 20:13:45,575 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:45,575 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:45,578 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:45,578 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(lhs+rhs)[by: lhs:[{1}:'num'] rhs:[{1}:'num']]
2015-05-20 20:13:45,586 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt
2015-05-20 20:13:45,601 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:45,601 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:45,603 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt"]
2015-05-20 20:13:45,603 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(lhs+rhs)[by: lhs:[{1}:'num'] rhs:[{1}:'num']]
2015-05-20 20:13:45,615 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 20:13:45,615 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 20:13:45,618 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(lhs+rhs)[by: lhs:[{1}:'num'] rhs:[{1}:'num']]
2015-05-20 20:13:45,619 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['item']->['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/uniquemerge-nondeterministic"]
2015-05-20 20:13:45,644 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/uniquemerge-nondeterministic/_temporary
2015-05-20 20:13:45,668 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/assemblyhelpersplatform/uniquemerge-nondeterministic
2015-05-20 20:13:45,678 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:13:45,678 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:13:45,683 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] starting
2015-05-20 20:13:45,684 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:45,684 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] sink: Hfs["TextLine[['item']->['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/unique"]
2015-05-20 20:13:45,684 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] parallel execution is enabled: false
2015-05-20 20:13:45,684 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] starting jobs: 1
2015-05-20 20:13:45,684 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] allocating threads: 1
2015-05-20 20:13:45,684 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [shape] starting step: (1/1) ...blyhelpersplatform/unique
2015-05-20 20:13:45,735 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi156273232/.staging/job_local156273232_0040/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:45,736 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi156273232/.staging/job_local156273232_0040/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:45,758 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local156273232_0040/job_local156273232_0040.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:45,759 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local156273232_0040/job_local156273232_0040.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:45,759 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [shape] submitted hadoop job: job_local156273232_0040
2015-05-20 20:13:45,760 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [shape] tracking url: http://localhost:8080/
2015-05-20 20:13:45,762 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt
2015-05-20 20:13:45,773 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:45,773 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:45,776 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:45,776 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(shape)[by:[{1}:'num']]
2015-05-20 20:13:45,783 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 20:13:45,783 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 20:13:45,785 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(shape)[by:[{1}:'num']]
2015-05-20 20:13:45,785 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['item']->['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/unique"]
2015-05-20 20:13:45,810 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/unique/_temporary
2015-05-20 20:13:45,829 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/assemblyhelpersplatform/unique
2015-05-20 20:13:45,838 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:13:45,838 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:13:45,844 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] starting
2015-05-20 20:13:45,844 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:45,844 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] sink: Hfs["TextDelimited[['notnull', 'null']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/countnullnotnull"]
2015-05-20 20:13:45,845 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] parallel execution is enabled: false
2015-05-20 20:13:45,845 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] starting jobs: 1
2015-05-20 20:13:45,845 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] allocating threads: 1
2015-05-20 20:13:45,845 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count] starting step: (1/1) ...platform/countnullnotnull
2015-05-20 20:13:45,897 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi2099776281/.staging/job_local2099776281_0041/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:45,898 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi2099776281/.staging/job_local2099776281_0041/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:45,920 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local2099776281_0041/job_local2099776281_0041.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:45,920 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local2099776281_0041/job_local2099776281_0041.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:45,921 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count] submitted hadoop job: job_local2099776281_0041
2015-05-20 20:13:45,921 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count] tracking url: http://localhost:8080/
2015-05-20 20:13:45,924 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt
2015-05-20 20:13:45,939 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:45,940 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:45,943 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-05-20 20:13:45,944 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(count)[by:[{?}:NONE]]
2015-05-20 20:13:45,952 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 20:13:45,952 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 20:13:45,955 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(count)[by:[{?}:NONE]]
2015-05-20 20:13:45,955 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['notnull', 'null']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/countnullnotnull"]
2015-05-20 20:13:45,981 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/assemblyhelpersplatform/countnullnotnull/_temporary
2015-05-20 20:13:46,019 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/assemblyhelpersplatform/countnullnotnull