2015-05-20 15:49:06,701 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(187)) - found 1 test platforms from classpath
2015-05-20 15:49:06,731 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(237)) - installing platform: hadoop2-mr1
2015-05-20 15:49:06,731 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(238)) - running test: cascading.pipe.assembly.AssemblyHelpersPlatformTest
2015-05-20 15:49:06,752 INFO hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(105)) - not using cluster
2015-05-20 15:49:07,189 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2015-05-20 15:49:07,533 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 15:49:07,534 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 15:49:07,542 INFO property.AppProps (AppProps.java:getAppID(169)) - using app.id: 4B94BE669E714F9E96DC682A96E105D9
2015-05-20 15:49:07,755 INFO util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 2.7.0
2015-05-20 15:49:07,755 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] starting
2015-05-20 15:49:07,756 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs.txt"]
2015-05-20 15:49:07,756 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:07,756 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/multimerge+false637"]
2015-05-20 15:49:07,756 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] parallel execution is enabled: false
2015-05-20 15:49:07,756 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] starting jobs: 1
2015-05-20 15:49:07,757 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] allocating threads: 1
2015-05-20 15:49:07,758 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [name] starting step: (1/1) ...tform/multimerge+false637
2015-05-20 15:49:08,127 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi2119371384/.staging/job_local2119371384_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:08,134 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi2119371384/.staging/job_local2119371384_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:08,225 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local2119371384_0001/job_local2119371384_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:08,228 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local2119371384_0001/job_local2119371384_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:08,236 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [name] submitted hadoop job: job_local2119371384_0001
2015-05-20 15:49:08,236 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [name] tracking url: http://localhost:8080/
2015-05-20 15:49:08,284 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt
2015-05-20 15:49:08,362 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:08,362 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:08,402 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:08,402 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2015-05-20 15:49:08,415 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 15:49:08,415 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 98, total: 245, max: 672
2015-05-20 15:49:08,415 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 36% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:08,416 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 15:49:08,416 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 98, total: 245, max: 672
2015-05-20 15:49:08,416 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 36% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:08,417 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 15:49:08,417 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 98, total: 245, max: 672
2015-05-20 15:49:08,417 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 36% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:08,418 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 15:49:08,418 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 97, total: 245, max: 672
2015-05-20 15:49:08,418 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 36% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:08,439 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs.txt
2015-05-20 15:49:08,493 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:08,493 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:08,507 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs.txt"]
2015-05-20 15:49:08,508 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2015-05-20 15:49:08,564 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 15:49:08,564 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 92, total: 346, max: 672
2015-05-20 15:49:08,564 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 51% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:08,565 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 15:49:08,566 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 92, total: 346, max: 672
2015-05-20 15:49:08,566 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 51% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:08,566 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 15:49:08,567 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 92, total: 346, max: 672
2015-05-20 15:49:08,567 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 51% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:08,567 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 15:49:08,568 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 92, total: 346, max: 672
2015-05-20 15:49:08,568 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 51% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:08,663 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 15:49:08,663 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 15:49:08,683 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2015-05-20 15:49:08,683 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/multimerge+false637"]
2015-05-20 15:49:08,733 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/multimerge+false637/_temporary
2015-05-20 15:49:08,805 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/assemblyhelpersplatform/multimerge+false637
2015-05-20 15:49:08,826 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 15:49:08,827 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 15:49:08,846 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] starting
2015-05-20 15:49:08,846 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:08,847 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] sink: Hfs["TextDelimited[['num', 'min']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/minbystring"]
2015-05-20 15:49:08,847 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] parallel execution is enabled: false
2015-05-20 15:49:08,847 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] starting jobs: 1
2015-05-20 15:49:08,847 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] allocating threads: 1
2015-05-20 15:49:08,847 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [max] starting step: (1/1) ...lpersplatform/minbystring
2015-05-20 15:49:08,922 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi203526172/.staging/job_local203526172_0002/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:08,923 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi203526172/.staging/job_local203526172_0002/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:08,970 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local203526172_0002/job_local203526172_0002.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:08,972 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local203526172_0002/job_local203526172_0002.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:08,973 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [max] submitted hadoop job: job_local203526172_0002
2015-05-20 15:49:08,973 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [max] tracking url: http://localhost:8080/
2015-05-20 15:49:08,980 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt
2015-05-20 15:49:09,032 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:09,032 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:09,039 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:09,039 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(max)[by:[{1}:'num']]
2015-05-20 15:49:09,041 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 15:49:09,041 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 95, total: 446, max: 672
2015-05-20 15:49:09,042 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 66% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:09,042 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 15:49:09,042 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 95, total: 446, max: 672
2015-05-20 15:49:09,042 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 66% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:09,055 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 15:49:09,056 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 15:49:09,062 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(max)[by:[{1}:'num']]
2015-05-20 15:49:09,063 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['num', 'min']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/minbystring"]
2015-05-20 15:49:09,095 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/minbystring/_temporary
2015-05-20 15:49:09,153 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/assemblyhelpersplatform/minbystring
2015-05-20 15:49:09,185 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 15:49:09,186 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 15:49:09,234 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [average-lhs+average-rhs] starting
2015-05-20 15:49:09,234 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [average-lhs+average-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs.txt"]
2015-05-20 15:49:09,235 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [average-lhs+average-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:09,235 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [average-lhs+average-rhs] sink: Hfs["TextDelimited[['char', 'average']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/mergeaverage"]
2015-05-20 15:49:09,235 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [average-lhs+average-rhs] parallel execution is enabled: false
2015-05-20 15:49:09,235 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [average-lhs+average-rhs] starting jobs: 1
2015-05-20 15:49:09,235 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [average-lhs+average-rhs] allocating threads: 1
2015-05-20 15:49:09,236 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [average-lhs+average-rhs] starting step: (1/1) ...persplatform/mergeaverage
2015-05-20 15:49:09,372 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi1541067532/.staging/job_local1541067532_0003/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:09,375 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi1541067532/.staging/job_local1541067532_0003/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:09,446 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local1541067532_0003/job_local1541067532_0003.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:09,447 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local1541067532_0003/job_local1541067532_0003.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:09,448 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [average-lhs+average-rhs] submitted hadoop job: job_local1541067532_0003
2015-05-20 15:49:09,448 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [average-lhs+average-rhs] tracking url: http://localhost:8080/
2015-05-20 15:49:09,452 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt
2015-05-20 15:49:09,503 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:09,503 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:09,511 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:09,511 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(average-lhs+average-rhs)[by: average-lhs:[{1}:'char'] average-rhs:[{1}:'char']]
2015-05-20 15:49:09,513 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 15:49:09,513 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 166, total: 611, max: 672
2015-05-20 15:49:09,514 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 15:49:09,514 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 166, total: 611, max: 672
2015-05-20 15:49:09,514 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 15:49:09,515 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 166, total: 611, max: 672
2015-05-20 15:49:09,515 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 15:49:09,515 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 166, total: 611, max: 672
2015-05-20 15:49:09,523 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs.txt
2015-05-20 15:49:09,572 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:09,572 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:09,580 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs.txt"]
2015-05-20 15:49:09,580 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(average-lhs+average-rhs)[by: average-lhs:[{1}:'char'] average-rhs:[{1}:'char']]
2015-05-20 15:49:09,583 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 15:49:09,583 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 97, total: 643, max: 672
2015-05-20 15:49:09,584 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 15:49:09,584 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 97, total: 643, max: 672
2015-05-20 15:49:09,585 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 15:49:09,585 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 96, total: 643, max: 672
2015-05-20 15:49:09,585 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 15:49:09,585 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 96, total: 643, max: 672
2015-05-20 15:49:09,600 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 15:49:09,601 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 15:49:09,608 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(average-lhs+average-rhs)[by: average-lhs:[{1}:'char'] average-rhs:[{1}:'char']]
2015-05-20 15:49:09,609 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'average']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/mergeaverage"]
2015-05-20 15:49:09,644 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/mergeaverage/_temporary
2015-05-20 15:49:09,689 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/assemblyhelpersplatform/mergeaverage
2015-05-20 15:49:09,705 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 15:49:09,705 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 15:49:09,718 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] starting
2015-05-20 15:49:09,718 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt"]
2015-05-20 15:49:09,718 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] sink: Hfs["TextLine[['line']->['item', 'element']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/renameall"]
2015-05-20 15:49:09,718 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] parallel execution is enabled: false
2015-05-20 15:49:09,718 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] starting jobs: 1
2015-05-20 15:49:09,718 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] allocating threads: 1
2015-05-20 15:49:09,719 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [shape] starting step: (1/1) ...helpersplatform/renameall
2015-05-20 15:49:09,796 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi1980516653/.staging/job_local1980516653_0004/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:09,797 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi1980516653/.staging/job_local1980516653_0004/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:09,842 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local1980516653_0004/job_local1980516653_0004.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:09,843 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local1980516653_0004/job_local1980516653_0004.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:09,844 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [shape] submitted hadoop job: job_local1980516653_0004
2015-05-20 15:49:09,844 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [shape] tracking url: http://localhost:8080/
2015-05-20 15:49:09,848 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt
2015-05-20 15:49:09,855 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:09,855 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:09,859 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt"]
2015-05-20 15:49:09,860 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['line']->['item', 'element']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/renameall"]
2015-05-20 15:49:09,882 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/renameall/_temporary
2015-05-20 15:49:09,910 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/assemblyhelpersplatform/renameall
2015-05-20 15:49:09,928 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 15:49:09,928 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 15:49:09,955 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] starting
2015-05-20 15:49:09,955 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:09,955 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] sink: Hfs["TextDelimited[['count', 'count2']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/countcount"]
2015-05-20 15:49:09,956 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] parallel execution is enabled: false
2015-05-20 15:49:09,956 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] starting jobs: 2
2015-05-20 15:49:09,956 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] allocating threads: 1
2015-05-20 15:49:09,956 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count] starting step: (1/2)
2015-05-20 15:49:10,149 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi2088199884/.staging/job_local2088199884_0005/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:10,150 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi2088199884/.staging/job_local2088199884_0005/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:10,181 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local2088199884_0005/job_local2088199884_0005.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:10,182 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local2088199884_0005/job_local2088199884_0005.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:10,182 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count] submitted hadoop job: job_local2088199884_0005
2015-05-20 15:49:10,182 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count] tracking url: http://localhost:8080/
2015-05-20 15:49:10,186 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt
2015-05-20 15:49:10,201 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:10,201 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:10,206 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:10,207 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(count)[by:[{1}:'char']]
2015-05-20 15:49:10,208 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 15:49:10,208 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 139, total: 268, max: 672
2015-05-20 15:49:10,208 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 39% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:10,209 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 15:49:10,209 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 139, total: 268, max: 672
2015-05-20 15:49:10,209 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 39% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:10,209 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 15:49:10,209 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 139, total: 268, max: 672
2015-05-20 15:49:10,209 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 39% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:10,210 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 15:49:10,210 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 139, total: 268, max: 672
2015-05-20 15:49:10,210 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 39% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:10,224 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 15:49:10,224 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 15:49:10,231 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(count)[by:[{1}:'char']]
2015-05-20 15:49:10,231 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: TempHfs["SequenceFile[['count', 'count2']]"][9306926017/count/]
2015-05-20 15:49:10,248 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 15:49:10,248 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 133, total: 268, max: 672
2015-05-20 15:49:10,248 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 39% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:10,271 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count] starting step: (2/2) ...elpersplatform/countcount
2015-05-20 15:49:10,368 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi1210093909/.staging/job_local1210093909_0006/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:10,369 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi1210093909/.staging/job_local1210093909_0006/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:10,405 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local1210093909_0006/job_local1210093909_0006.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:10,406 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local1210093909_0006/job_local1210093909_0006.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:10,407 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count] submitted hadoop job: job_local1210093909_0006
2015-05-20 15:49:10,407 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count] tracking url: http://localhost:8080/
2015-05-20 15:49:10,412 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-soberoi/9306926017_count_4211AC55552941A3A0AB5EDB6D321C3A/part-00000
2015-05-20 15:49:10,430 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:10,431 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:10,436 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: TempHfs["SequenceFile[['count', 'count2']]"][9306926017/count/]
2015-05-20 15:49:10,436 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(count)[by:[{1}:'count']]
2015-05-20 15:49:10,450 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 15:49:10,450 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 15:49:10,456 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(count)[by:[{1}:'count']]
2015-05-20 15:49:10,457 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['count', 'count2']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/countcount"]
2015-05-20 15:49:10,494 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/countcount/_temporary
2015-05-20 15:49:10,542 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/assemblyhelpersplatform/countcount
2015-05-20 15:49:10,559 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 15:49:10,559 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 15:49:10,576 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count-lhs+count-rhs] starting
2015-05-20 15:49:10,577 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count-lhs+count-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs.txt"]
2015-05-20 15:49:10,577 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count-lhs+count-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:10,577 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count-lhs+count-rhs] sink: Hfs["TextDelimited[['char', 'count']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/mergecount"]
2015-05-20 15:49:10,577 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count-lhs+count-rhs] parallel execution is enabled: false
2015-05-20 15:49:10,577 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count-lhs+count-rhs] starting jobs: 1
2015-05-20 15:49:10,577 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count-lhs+count-rhs] allocating threads: 1
2015-05-20 15:49:10,578 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count-lhs+count-rhs] starting step: (1/1) ...elpersplatform/mergecount
2015-05-20 15:49:10,646 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi1630748029/.staging/job_local1630748029_0007/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:10,646 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi1630748029/.staging/job_local1630748029_0007/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:10,682 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local1630748029_0007/job_local1630748029_0007.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:10,682 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local1630748029_0007/job_local1630748029_0007.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:10,683 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count-lhs+count-rhs] submitted hadoop job: job_local1630748029_0007
2015-05-20 15:49:10,683 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count-lhs+count-rhs] tracking url: http://localhost:8080/
2015-05-20 15:49:10,687 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt
2015-05-20 15:49:10,729 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:10,729 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:10,736 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:10,736 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(count-lhs+count-rhs)[by: count-lhs:[{1}:'char'] count-rhs:[{1}:'char']]
2015-05-20 15:49:10,737 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 15:49:10,737 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 61, total: 368, max: 672
2015-05-20 15:49:10,737 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 54% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:10,738 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 15:49:10,738 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 61, total: 368, max: 672
2015-05-20 15:49:10,738 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 54% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:10,739 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 15:49:10,739 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 61, total: 368, max: 672
2015-05-20 15:49:10,739 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 54% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:10,739 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 15:49:10,739 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 61, total: 368, max: 672
2015-05-20 15:49:10,739 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 54% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:10,746 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs.txt
2015-05-20 15:49:10,795 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:10,795 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:10,802 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs.txt"]
2015-05-20 15:49:10,802 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(count-lhs+count-rhs)[by: count-lhs:[{1}:'char'] count-rhs:[{1}:'char']]
2015-05-20 15:49:10,805 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 15:49:10,805 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 59, total: 469, max: 672
2015-05-20 15:49:10,805 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 69% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:10,806 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 15:49:10,806 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 59, total: 469, max: 672
2015-05-20 15:49:10,806 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 69% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:10,806 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 15:49:10,806 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 59, total: 469, max: 672
2015-05-20 15:49:10,807 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 69% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:10,807 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 15:49:10,807 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 59, total: 469, max: 672
2015-05-20 15:49:10,807 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 69% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:10,824 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 15:49:10,825 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 15:49:10,831 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(count-lhs+count-rhs)[by: count-lhs:[{1}:'char'] count-rhs:[{1}:'char']]
2015-05-20 15:49:10,831 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'count']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/mergecount"]
2015-05-20 15:49:10,867 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/mergecount/_temporary
2015-05-20 15:49:10,923 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/assemblyhelpersplatform/mergecount
2015-05-20 15:49:10,944 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 15:49:10,944 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 15:49:10,958 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [min] starting
2015-05-20 15:49:10,959 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [min] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:10,959 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [min] sink: Hfs["TextDelimited[['char', 'min']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/minbynullsafety"]
2015-05-20 15:49:10,959 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [min] parallel execution is enabled: false
2015-05-20 15:49:10,959 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [min] starting jobs: 1
2015-05-20 15:49:10,959 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [min] allocating threads: 1
2015-05-20 15:49:10,960 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [min] starting step: (1/1) ...splatform/minbynullsafety
2015-05-20 15:49:11,033 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi640429544/.staging/job_local640429544_0008/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:11,033 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi640429544/.staging/job_local640429544_0008/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:11,067 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local640429544_0008/job_local640429544_0008.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:11,068 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local640429544_0008/job_local640429544_0008.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:11,068 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [min] submitted hadoop job: job_local640429544_0008
2015-05-20 15:49:11,068 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [min] tracking url: http://localhost:8080/
2015-05-20 15:49:11,072 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt
2015-05-20 15:49:11,085 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:11,085 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:11,090 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:11,090 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(min)[by:[{1}:'char']]
2015-05-20 15:49:11,091 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 15:49:11,092 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 70, total: 512, max: 672
2015-05-20 15:49:11,092 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 76% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:11,092 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 15:49:11,092 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 70, total: 512, max: 672
2015-05-20 15:49:11,093 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 76% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:11,093 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 15:49:11,093 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 70, total: 512, max: 672
2015-05-20 15:49:11,093 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 76% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:11,094 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 15:49:11,094 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 70, total: 512, max: 672
2015-05-20 15:49:11,094 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 76% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:11,108 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 15:49:11,108 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 15:49:11,114 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(min)[by:[{1}:'char']]
2015-05-20 15:49:11,114 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'min']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/minbynullsafety"]
2015-05-20 15:49:11,143 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/minbynullsafety/_temporary
2015-05-20 15:49:11,201 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/assemblyhelpersplatform/minbynullsafety
2015-05-20 15:49:11,221 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 15:49:11,221 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 15:49:11,237 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] starting
2015-05-20 15:49:11,238 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:11,238 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] sink: Hfs["TextDelimited[['num', 'max']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/maxbystring"]
2015-05-20 15:49:11,238 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] parallel execution is enabled: false
2015-05-20 15:49:11,239 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] starting jobs: 1
2015-05-20 15:49:11,239 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] allocating threads: 1
2015-05-20 15:49:11,239 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [max] starting step: (1/1) ...lpersplatform/maxbystring
2015-05-20 15:49:11,329 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi95983736/.staging/job_local95983736_0009/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:11,330 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi95983736/.staging/job_local95983736_0009/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:11,369 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local95983736_0009/job_local95983736_0009.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:11,370 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local95983736_0009/job_local95983736_0009.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:11,370 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [max] submitted hadoop job: job_local95983736_0009
2015-05-20 15:49:11,371 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [max] tracking url: http://localhost:8080/
2015-05-20 15:49:11,374 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt
2015-05-20 15:49:11,388 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:11,388 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:11,392 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:11,393 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(max)[by:[{1}:'num']]
2015-05-20 15:49:11,394 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 15:49:11,394 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 81, total: 515, max: 672
2015-05-20 15:49:11,394 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 76% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:11,394 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 15:49:11,395 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 81, total: 515, max: 672
2015-05-20 15:49:11,395 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 76% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:11,414 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 15:49:11,414 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 15:49:11,419 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(max)[by:[{1}:'num']]
2015-05-20 15:49:11,419 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['num', 'max']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/maxbystring"]
2015-05-20 15:49:11,445 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/maxbystring/_temporary
2015-05-20 15:49:11,492 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/assemblyhelpersplatform/maxbystring
2015-05-20 15:49:11,510 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 15:49:11,510 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 15:49:11,525 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [first] starting
2015-05-20 15:49:11,525 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [first] source: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs+rhs-cross.txt"]
2015-05-20 15:49:11,525 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [first] sink: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/firstnfields"]
2015-05-20 15:49:11,525 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [first] parallel execution is enabled: false
2015-05-20 15:49:11,525 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [first] starting jobs: 1
2015-05-20 15:49:11,525 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [first] allocating threads: 1
2015-05-20 15:49:11,526 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [first] starting step: (1/1) ...persplatform/firstnfields
2015-05-20 15:49:11,594 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi303576252/.staging/job_local303576252_0010/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:11,595 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi303576252/.staging/job_local303576252_0010/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:11,675 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local303576252_0010/job_local303576252_0010.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:11,676 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local303576252_0010/job_local303576252_0010.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:11,676 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [first] submitted hadoop job: job_local303576252_0010
2015-05-20 15:49:11,677 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [first] tracking url: http://localhost:8080/
2015-05-20 15:49:11,680 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs+rhs-cross.txt
2015-05-20 15:49:11,694 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:11,694 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:11,699 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs+rhs-cross.txt"]
2015-05-20 15:49:11,700 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(first)[by:[{1}:'num']]
2015-05-20 15:49:11,702 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 15:49:11,702 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 316, total: 440, max: 672
2015-05-20 15:49:11,702 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:11,703 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 15:49:11,703 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 316, total: 440, max: 672
2015-05-20 15:49:11,703 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:11,715 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 15:49:11,715 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 15:49:11,721 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(first)[by:[{1}:'num']]
2015-05-20 15:49:11,722 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/firstnfields"]
2015-05-20 15:49:11,750 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/firstnfields/_temporary
2015-05-20 15:49:11,774 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/assemblyhelpersplatform/firstnfields
2015-05-20 15:49:11,791 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 15:49:11,791 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 15:49:11,802 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [coerce] starting
2015-05-20 15:49:11,802 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [coerce] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt"]
2015-05-20 15:49:11,802 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [coerce] sink: Hfs["TextLine[['line']->['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/coercefields"]
2015-05-20 15:49:11,802 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [coerce] parallel execution is enabled: false
2015-05-20 15:49:11,802 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [coerce] starting jobs: 1
2015-05-20 15:49:11,803 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [coerce] allocating threads: 1
2015-05-20 15:49:11,803 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [coerce] starting step: (1/1) ...persplatform/coercefields
2015-05-20 15:49:11,860 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi1362488329/.staging/job_local1362488329_0011/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:11,861 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi1362488329/.staging/job_local1362488329_0011/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:11,892 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local1362488329_0011/job_local1362488329_0011.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:11,893 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local1362488329_0011/job_local1362488329_0011.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:11,894 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [coerce] submitted hadoop job: job_local1362488329_0011
2015-05-20 15:49:11,894 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [coerce] tracking url: http://localhost:8080/
2015-05-20 15:49:11,897 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt
2015-05-20 15:49:11,903 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:11,903 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:11,908 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt"]
2015-05-20 15:49:11,909 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['line']->['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/coercefields"]
2015-05-20 15:49:11,929 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/coercefields/_temporary
2015-05-20 15:49:11,953 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/assemblyhelpersplatform/coercefields
2015-05-20 15:49:11,967 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 15:49:11,967 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 15:49:11,978 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] starting
2015-05-20 15:49:11,978 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:11,978 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] sink: Hfs["TextDelimited[['char', 'count']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/count"]
2015-05-20 15:49:11,978 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] parallel execution is enabled: false
2015-05-20 15:49:11,978 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] starting jobs: 1
2015-05-20 15:49:11,978 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] allocating threads: 1
2015-05-20 15:49:11,979 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count] starting step: (1/1) ...mblyhelpersplatform/count
2015-05-20 15:49:12,046 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi1026368798/.staging/job_local1026368798_0012/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:12,047 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi1026368798/.staging/job_local1026368798_0012/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:12,088 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local1026368798_0012/job_local1026368798_0012.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:12,089 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local1026368798_0012/job_local1026368798_0012.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:12,089 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count] submitted hadoop job: job_local1026368798_0012
2015-05-20 15:49:12,089 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count] tracking url: http://localhost:8080/
2015-05-20 15:49:12,092 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt
2015-05-20 15:49:12,105 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:12,105 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:12,110 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:12,111 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(count)[by:[{1}:'char']]
2015-05-20 15:49:12,112 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 15:49:12,112 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 312, total: 429, max: 672
2015-05-20 15:49:12,112 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 63% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:12,112 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 15:49:12,113 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 312, total: 429, max: 672
2015-05-20 15:49:12,113 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 63% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:12,113 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 15:49:12,113 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 312, total: 429, max: 672
2015-05-20 15:49:12,113 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 63% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:12,114 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 15:49:12,114 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 312, total: 429, max: 672
2015-05-20 15:49:12,114 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 63% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:12,126 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 15:49:12,126 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 15:49:12,134 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(count)[by:[{1}:'char']]
2015-05-20 15:49:12,134 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'count']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/count"]
2015-05-20 15:49:12,161 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/count/_temporary
2015-05-20 15:49:12,204 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/assemblyhelpersplatform/count
2015-05-20 15:49:12,222 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 15:49:12,222 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 15:49:12,234 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] starting
2015-05-20 15:49:12,234 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:12,234 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] sink: Hfs["TextDelimited[['char', 'max']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/maxby"]
2015-05-20 15:49:12,234 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] parallel execution is enabled: false
2015-05-20 15:49:12,234 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] starting jobs: 1
2015-05-20 15:49:12,234 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] allocating threads: 1
2015-05-20 15:49:12,235 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [max] starting step: (1/1) ...mblyhelpersplatform/maxby
2015-05-20 15:49:12,301 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi321295027/.staging/job_local321295027_0013/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:12,302 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi321295027/.staging/job_local321295027_0013/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:12,333 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local321295027_0013/job_local321295027_0013.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:12,334 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local321295027_0013/job_local321295027_0013.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:12,334 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [max] submitted hadoop job: job_local321295027_0013
2015-05-20 15:49:12,335 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [max] tracking url: http://localhost:8080/
2015-05-20 15:49:12,338 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt
2015-05-20 15:49:12,353 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:12,353 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:12,358 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:12,358 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(max)[by:[{1}:'char']]
2015-05-20 15:49:12,359 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 15:49:12,359 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 325, total: 439, max: 672
2015-05-20 15:49:12,359 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:12,360 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 15:49:12,360 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 325, total: 439, max: 672
2015-05-20 15:49:12,360 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:12,360 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 15:49:12,360 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 325, total: 439, max: 672
2015-05-20 15:49:12,360 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:12,361 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 15:49:12,361 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 325, total: 439, max: 672
2015-05-20 15:49:12,361 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:12,371 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 15:49:12,372 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 15:49:12,377 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(max)[by:[{1}:'char']]
2015-05-20 15:49:12,377 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'max']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/maxby"]
2015-05-20 15:49:12,401 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/maxby/_temporary
2015-05-20 15:49:12,445 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/assemblyhelpersplatform/maxby
2015-05-20 15:49:12,456 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 15:49:12,456 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 15:49:12,466 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [min] starting
2015-05-20 15:49:12,466 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [min] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:12,466 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [min] sink: Hfs["TextDelimited[['char', 'min']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/minby"]
2015-05-20 15:49:12,466 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [min] parallel execution is enabled: false
2015-05-20 15:49:12,466 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [min] starting jobs: 1
2015-05-20 15:49:12,466 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [min] allocating threads: 1
2015-05-20 15:49:12,467 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [min] starting step: (1/1) ...mblyhelpersplatform/minby
2015-05-20 15:49:12,527 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi1973336865/.staging/job_local1973336865_0014/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:12,528 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi1973336865/.staging/job_local1973336865_0014/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:12,561 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local1973336865_0014/job_local1973336865_0014.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:12,562 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local1973336865_0014/job_local1973336865_0014.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:12,562 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [min] submitted hadoop job: job_local1973336865_0014
2015-05-20 15:49:12,563 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [min] tracking url: http://localhost:8080/
2015-05-20 15:49:12,566 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt
2015-05-20 15:49:12,585 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:12,585 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:12,592 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:12,592 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(min)[by:[{1}:'char']]
2015-05-20 15:49:12,593 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 15:49:12,593 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 325, total: 439, max: 672
2015-05-20 15:49:12,593 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:12,594 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 15:49:12,594 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 325, total: 439, max: 672
2015-05-20 15:49:12,594 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:12,595 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 15:49:12,595 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 325, total: 439, max: 672
2015-05-20 15:49:12,595 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:12,595 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 15:49:12,596 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 325, total: 439, max: 672
2015-05-20 15:49:12,596 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:12,608 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 15:49:12,609 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 15:49:12,615 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(min)[by:[{1}:'char']]
2015-05-20 15:49:12,615 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'min']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/minby"]
2015-05-20 15:49:12,648 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/minby/_temporary
2015-05-20 15:49:12,698 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/assemblyhelpersplatform/minby
2015-05-20 15:49:12,710 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 15:49:12,711 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 15:49:12,722 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [sum] starting
2015-05-20 15:49:12,722 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [sum] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:12,722 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [sum] sink: Hfs["TextDelimited[['char', 'sum']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/sum"]
2015-05-20 15:49:12,722 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [sum] parallel execution is enabled: false
2015-05-20 15:49:12,722 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [sum] starting jobs: 1
2015-05-20 15:49:12,722 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [sum] allocating threads: 1
2015-05-20 15:49:12,723 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [sum] starting step: (1/1) ...semblyhelpersplatform/sum
2015-05-20 15:49:12,778 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi1740884051/.staging/job_local1740884051_0015/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:12,779 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi1740884051/.staging/job_local1740884051_0015/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:12,807 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local1740884051_0015/job_local1740884051_0015.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:12,808 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local1740884051_0015/job_local1740884051_0015.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:12,808 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [sum] submitted hadoop job: job_local1740884051_0015
2015-05-20 15:49:12,809 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [sum] tracking url: http://localhost:8080/
2015-05-20 15:49:12,812 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt
2015-05-20 15:49:12,827 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:12,827 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:12,833 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:12,833 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(sum)[by:[{1}:'char']]
2015-05-20 15:49:12,834 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 15:49:12,834 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 326, total: 440, max: 672
2015-05-20 15:49:12,834 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:12,835 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 15:49:12,835 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 325, total: 440, max: 672
2015-05-20 15:49:12,835 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:12,835 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 15:49:12,835 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 325, total: 440, max: 672
2015-05-20 15:49:12,835 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:12,836 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 15:49:12,836 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 325, total: 440, max: 672
2015-05-20 15:49:12,836 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:12,847 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 15:49:12,847 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 15:49:12,852 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(sum)[by:[{1}:'char']]
2015-05-20 15:49:12,852 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'sum']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/sum"]
2015-05-20 15:49:12,884 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/sum/_temporary
2015-05-20 15:49:12,928 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/assemblyhelpersplatform/sum
2015-05-20 15:49:12,941 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 15:49:12,941 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 15:49:12,954 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [sum-lhs+sum-rhs] starting
2015-05-20 15:49:12,954 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [sum-lhs+sum-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs.txt"]
2015-05-20 15:49:12,954 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [sum-lhs+sum-rhs] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:12,954 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [sum-lhs+sum-rhs] sink: Hfs["TextDelimited[['char', 'sum']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/mergesum"]
2015-05-20 15:49:12,955 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [sum-lhs+sum-rhs] parallel execution is enabled: false
2015-05-20 15:49:12,955 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [sum-lhs+sum-rhs] starting jobs: 1
2015-05-20 15:49:12,955 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [sum-lhs+sum-rhs] allocating threads: 1
2015-05-20 15:49:12,955 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [sum-lhs+sum-rhs] starting step: (1/1) ...yhelpersplatform/mergesum
2015-05-20 15:49:13,015 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi589771123/.staging/job_local589771123_0016/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:13,016 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi589771123/.staging/job_local589771123_0016/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:13,046 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local589771123_0016/job_local589771123_0016.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:13,047 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local589771123_0016/job_local589771123_0016.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:13,048 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [sum-lhs+sum-rhs] submitted hadoop job: job_local589771123_0016
2015-05-20 15:49:13,048 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [sum-lhs+sum-rhs] tracking url: http://localhost:8080/
2015-05-20 15:49:13,051 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt
2015-05-20 15:49:13,065 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:13,066 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:13,072 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:13,072 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(sum-lhs+sum-rhs)[by: sum-lhs:[{1}:'char'] sum-rhs:[{1}:'char']]
2015-05-20 15:49:13,073 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 15:49:13,073 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 325, total: 440, max: 672
2015-05-20 15:49:13,073 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:13,074 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 15:49:13,074 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 325, total: 440, max: 672
2015-05-20 15:49:13,074 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:13,075 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 15:49:13,075 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 325, total: 440, max: 672
2015-05-20 15:49:13,075 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:13,075 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 15:49:13,075 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 325, total: 440, max: 672
2015-05-20 15:49:13,075 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:13,082 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs.txt
2015-05-20 15:49:13,100 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:13,100 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:13,106 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs.txt"]
2015-05-20 15:49:13,106 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(sum-lhs+sum-rhs)[by: sum-lhs:[{1}:'char'] sum-rhs:[{1}:'char']]
2015-05-20 15:49:13,109 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 15:49:13,109 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 224, total: 440, max: 672
2015-05-20 15:49:13,109 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:13,110 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 15:49:13,110 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 224, total: 440, max: 672
2015-05-20 15:49:13,110 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:13,110 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 15:49:13,110 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 224, total: 440, max: 672
2015-05-20 15:49:13,110 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:13,111 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 15:49:13,111 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 223, total: 440, max: 672
2015-05-20 15:49:13,111 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:13,123 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 15:49:13,124 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 15:49:13,130 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(sum-lhs+sum-rhs)[by: sum-lhs:[{1}:'char'] sum-rhs:[{1}:'char']]
2015-05-20 15:49:13,130 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'sum']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/mergesum"]
2015-05-20 15:49:13,152 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/mergesum/_temporary
2015-05-20 15:49:13,196 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/assemblyhelpersplatform/mergesum
2015-05-20 15:49:13,210 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 15:49:13,210 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 15:49:13,218 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] starting
2015-05-20 15:49:13,219 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt"]
2015-05-20 15:49:13,219 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] sink: Hfs["TextLine[['num']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/discardnarrow"]
2015-05-20 15:49:13,219 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] parallel execution is enabled: false
2015-05-20 15:49:13,219 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] starting jobs: 1
2015-05-20 15:49:13,219 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] allocating threads: 1
2015-05-20 15:49:13,219 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [shape] starting step: (1/1) ...ersplatform/discardnarrow
2015-05-20 15:49:13,276 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi950732459/.staging/job_local950732459_0017/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:13,277 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi950732459/.staging/job_local950732459_0017/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:13,308 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local950732459_0017/job_local950732459_0017.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:13,309 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local950732459_0017/job_local950732459_0017.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:13,310 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [shape] submitted hadoop job: job_local950732459_0017
2015-05-20 15:49:13,310 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [shape] tracking url: http://localhost:8080/
2015-05-20 15:49:13,313 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt
2015-05-20 15:49:13,318 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:13,318 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:13,321 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt"]
2015-05-20 15:49:13,321 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['num']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/discardnarrow"]
2015-05-20 15:49:13,336 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/discardnarrow/_temporary
2015-05-20 15:49:13,361 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/assemblyhelpersplatform/discardnarrow
2015-05-20 15:49:13,376 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 15:49:13,376 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 15:49:13,399 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] starting
2015-05-20 15:49:13,399 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs.txt"]
2015-05-20 15:49:13,399 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:13,399 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/multimerge+true638"]
2015-05-20 15:49:13,399 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] parallel execution is enabled: false
2015-05-20 15:49:13,399 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] starting jobs: 1
2015-05-20 15:49:13,400 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] allocating threads: 1
2015-05-20 15:49:13,400 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [name] starting step: (1/1) ...atform/multimerge+true638
2015-05-20 15:49:13,461 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi955898708/.staging/job_local955898708_0018/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:13,462 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi955898708/.staging/job_local955898708_0018/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:13,492 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local955898708_0018/job_local955898708_0018.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:13,493 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local955898708_0018/job_local955898708_0018.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:13,493 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [name] submitted hadoop job: job_local955898708_0018
2015-05-20 15:49:13,493 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [name] tracking url: http://localhost:8080/
2015-05-20 15:49:13,497 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt
2015-05-20 15:49:13,510 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:13,510 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:13,517 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:13,517 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2015-05-20 15:49:13,518 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 15:49:13,518 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 233, total: 440, max: 672
2015-05-20 15:49:13,518 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:13,519 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 15:49:13,519 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 233, total: 440, max: 672
2015-05-20 15:49:13,519 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:13,519 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 15:49:13,520 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 233, total: 440, max: 672
2015-05-20 15:49:13,520 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:13,520 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 15:49:13,520 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 232, total: 440, max: 672
2015-05-20 15:49:13,520 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:13,526 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs.txt
2015-05-20 15:49:13,541 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:13,541 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:13,547 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs.txt"]
2015-05-20 15:49:13,548 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2015-05-20 15:49:13,550 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 15:49:13,550 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 325, total: 440, max: 672
2015-05-20 15:49:13,550 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:13,551 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 15:49:13,551 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 325, total: 440, max: 672
2015-05-20 15:49:13,551 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:13,552 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 15:49:13,552 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 325, total: 440, max: 672
2015-05-20 15:49:13,552 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:13,553 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 15:49:13,553 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 325, total: 440, max: 672
2015-05-20 15:49:13,553 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:13,567 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 15:49:13,567 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 15:49:13,574 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(name)[by:[{1}:'char']]
2015-05-20 15:49:13,574 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/multimerge+true638"]
2015-05-20 15:49:13,602 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/multimerge+true638/_temporary
2015-05-20 15:49:13,644 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/assemblyhelpersplatform/multimerge+true638
2015-05-20 15:49:13,654 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 15:49:13,655 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 15:49:13,661 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] starting
2015-05-20 15:49:13,661 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt"]
2015-05-20 15:49:13,661 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] sink: Hfs["TextLine[['line']->['item', 'element']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/rename"]
2015-05-20 15:49:13,662 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] parallel execution is enabled: false
2015-05-20 15:49:13,662 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] starting jobs: 1
2015-05-20 15:49:13,662 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] allocating threads: 1
2015-05-20 15:49:13,662 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [shape] starting step: (1/1) ...blyhelpersplatform/rename
2015-05-20 15:49:13,720 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi641521092/.staging/job_local641521092_0019/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:13,720 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi641521092/.staging/job_local641521092_0019/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:13,749 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local641521092_0019/job_local641521092_0019.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:13,750 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local641521092_0019/job_local641521092_0019.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:13,751 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [shape] submitted hadoop job: job_local641521092_0019
2015-05-20 15:49:13,751 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [shape] tracking url: http://localhost:8080/
2015-05-20 15:49:13,754 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt
2015-05-20 15:49:13,760 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:13,760 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:13,763 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt"]
2015-05-20 15:49:13,763 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['line']->['item', 'element']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/rename"]
2015-05-20 15:49:13,776 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/rename/_temporary
2015-05-20 15:49:13,804 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/assemblyhelpersplatform/rename
2015-05-20 15:49:13,825 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 15:49:13,826 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 15:49:13,842 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] starting
2015-05-20 15:49:13,842 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs.txt"]
2015-05-20 15:49:13,842 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:13,843 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/multimerge+true637"]
2015-05-20 15:49:13,843 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] parallel execution is enabled: false
2015-05-20 15:49:13,843 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] starting jobs: 1
2015-05-20 15:49:13,843 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] allocating threads: 1
2015-05-20 15:49:13,843 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [name] starting step: (1/1) ...atform/multimerge+true637
2015-05-20 15:49:13,906 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi1615838350/.staging/job_local1615838350_0020/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:13,907 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi1615838350/.staging/job_local1615838350_0020/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:13,937 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local1615838350_0020/job_local1615838350_0020.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:13,938 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local1615838350_0020/job_local1615838350_0020.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:13,938 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [name] submitted hadoop job: job_local1615838350_0020
2015-05-20 15:49:13,939 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [name] tracking url: http://localhost:8080/
2015-05-20 15:49:13,942 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt
2015-05-20 15:49:13,958 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:13,958 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:13,964 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:13,964 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2015-05-20 15:49:13,965 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 15:49:13,965 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 326, total: 441, max: 672
2015-05-20 15:49:13,965 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:13,966 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 15:49:13,966 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 326, total: 441, max: 672
2015-05-20 15:49:13,966 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:13,966 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 15:49:13,966 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 326, total: 441, max: 672
2015-05-20 15:49:13,967 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:13,967 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 15:49:13,967 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 326, total: 441, max: 672
2015-05-20 15:49:13,967 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:13,973 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs.txt
2015-05-20 15:49:13,986 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:13,986 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:13,992 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs.txt"]
2015-05-20 15:49:13,992 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2015-05-20 15:49:13,995 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 15:49:13,995 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 224, total: 441, max: 672
2015-05-20 15:49:13,995 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:13,996 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 15:49:13,996 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 224, total: 441, max: 672
2015-05-20 15:49:13,996 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:13,996 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 15:49:13,996 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 224, total: 441, max: 672
2015-05-20 15:49:13,997 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:13,997 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 15:49:13,997 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 224, total: 441, max: 672
2015-05-20 15:49:13,997 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:14,014 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 15:49:14,014 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 15:49:14,021 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(name)[by:[{1}:'char']]
2015-05-20 15:49:14,021 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/multimerge+true637"]
2015-05-20 15:49:14,059 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/multimerge+true637/_temporary
2015-05-20 15:49:14,099 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/assemblyhelpersplatform/multimerge+true637
2015-05-20 15:49:14,115 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 15:49:14,115 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 15:49:14,137 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [second] starting
2015-05-20 15:49:14,137 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [second] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:14,137 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [second] sink: Hfs["TextDelimited[['char', 'count']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/samesourcemergecount"]
2015-05-20 15:49:14,137 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [second] parallel execution is enabled: false
2015-05-20 15:49:14,137 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [second] starting jobs: 2
2015-05-20 15:49:14,137 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [second] allocating threads: 1
2015-05-20 15:49:14,138 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [second] starting step: (1/2)
2015-05-20 15:49:14,192 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi1384249913/.staging/job_local1384249913_0021/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:14,193 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi1384249913/.staging/job_local1384249913_0021/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:14,221 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local1384249913_0021/job_local1384249913_0021.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:14,222 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local1384249913_0021/job_local1384249913_0021.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:14,223 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [second] submitted hadoop job: job_local1384249913_0021
2015-05-20 15:49:14,223 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [second] tracking url: http://localhost:8080/
2015-05-20 15:49:14,225 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt
2015-05-20 15:49:14,237 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:14,237 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:14,242 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:14,242 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(first)[by:[{1}:'char']]
2015-05-20 15:49:14,245 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 15:49:14,245 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 289, total: 441, max: 672
2015-05-20 15:49:14,245 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:14,245 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 15:49:14,246 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 289, total: 441, max: 672
2015-05-20 15:49:14,246 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:14,246 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 15:49:14,246 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 289, total: 441, max: 672
2015-05-20 15:49:14,246 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:14,246 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 15:49:14,247 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 289, total: 441, max: 672
2015-05-20 15:49:14,247 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:14,257 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 15:49:14,257 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 15:49:14,262 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(first)[by:[{1}:'char']]
2015-05-20 15:49:14,262 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: TempHfs["SequenceFile[['char', 'count']]"][7946457680/first/]
2015-05-20 15:49:14,282 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [second] starting step: (2/2) ...form/samesourcemergecount
2015-05-20 15:49:14,355 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi1867520166/.staging/job_local1867520166_0022/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:14,356 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi1867520166/.staging/job_local1867520166_0022/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:14,395 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local1867520166_0022/job_local1867520166_0022.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:14,396 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local1867520166_0022/job_local1867520166_0022.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:14,396 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [second] submitted hadoop job: job_local1867520166_0022
2015-05-20 15:49:14,397 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [second] tracking url: http://localhost:8080/
2015-05-20 15:49:14,400 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-soberoi/7946457680_first_93B395ECDF8945779C1E738A57C9DD38/part-00000
2015-05-20 15:49:14,417 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:14,417 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:14,422 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][7946457680/first/]
2015-05-20 15:49:14,422 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(second)[by:[{1}:'char']]
2015-05-20 15:49:14,423 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 15:49:14,423 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 327, total: 442, max: 672
2015-05-20 15:49:14,423 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:14,424 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 15:49:14,424 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 327, total: 442, max: 672
2015-05-20 15:49:14,424 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:14,434 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 15:49:14,434 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 15:49:14,439 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(second)[by:[{1}:'char']]
2015-05-20 15:49:14,440 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'count']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/samesourcemergecount"]
2015-05-20 15:49:14,459 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/samesourcemergecount/_temporary
2015-05-20 15:49:14,507 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/assemblyhelpersplatform/samesourcemergecount
2015-05-20 15:49:14,518 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 15:49:14,518 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 15:49:14,525 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [average] starting
2015-05-20 15:49:14,525 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [average] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:14,525 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [average] sink: Hfs["TextDelimited[['char', 'average']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/average"]
2015-05-20 15:49:14,525 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [average] parallel execution is enabled: false
2015-05-20 15:49:14,525 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [average] starting jobs: 1
2015-05-20 15:49:14,525 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [average] allocating threads: 1
2015-05-20 15:49:14,526 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [average] starting step: (1/1) ...lyhelpersplatform/average
2015-05-20 15:49:14,593 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi1768859365/.staging/job_local1768859365_0023/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:14,594 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi1768859365/.staging/job_local1768859365_0023/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:14,625 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local1768859365_0023/job_local1768859365_0023.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:14,626 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local1768859365_0023/job_local1768859365_0023.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:14,626 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [average] submitted hadoop job: job_local1768859365_0023
2015-05-20 15:49:14,627 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [average] tracking url: http://localhost:8080/
2015-05-20 15:49:14,629 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt
2015-05-20 15:49:14,644 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:14,645 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:14,648 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:14,648 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(average)[by:[{1}:'char']]
2015-05-20 15:49:14,649 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 15:49:14,649 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 328, total: 442, max: 672
2015-05-20 15:49:14,649 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:14,650 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 15:49:14,650 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 328, total: 442, max: 672
2015-05-20 15:49:14,650 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:14,650 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 15:49:14,651 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 328, total: 442, max: 672
2015-05-20 15:49:14,651 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:14,651 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 15:49:14,651 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 328, total: 442, max: 672
2015-05-20 15:49:14,651 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:14,661 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 15:49:14,661 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 15:49:14,665 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(average)[by:[{1}:'char']]
2015-05-20 15:49:14,665 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'average']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/average"]
2015-05-20 15:49:14,694 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/average/_temporary
2015-05-20 15:49:14,740 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/assemblyhelpersplatform/average
2015-05-20 15:49:14,751 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 15:49:14,751 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 15:49:14,758 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] starting
2015-05-20 15:49:14,758 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:14,758 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] sink: Hfs["TextDelimited[['char', 'max']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/maxbynullsafety"]
2015-05-20 15:49:14,758 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] parallel execution is enabled: false
2015-05-20 15:49:14,758 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] starting jobs: 1
2015-05-20 15:49:14,758 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [max] allocating threads: 1
2015-05-20 15:49:14,759 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [max] starting step: (1/1) ...splatform/maxbynullsafety
2015-05-20 15:49:14,814 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi432839581/.staging/job_local432839581_0024/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:14,815 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi432839581/.staging/job_local432839581_0024/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:14,845 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local432839581_0024/job_local432839581_0024.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:14,846 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local432839581_0024/job_local432839581_0024.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:14,847 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [max] submitted hadoop job: job_local432839581_0024
2015-05-20 15:49:14,847 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [max] tracking url: http://localhost:8080/
2015-05-20 15:49:14,851 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt
2015-05-20 15:49:14,865 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:14,865 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:14,870 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:14,870 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(max)[by:[{1}:'char']]
2015-05-20 15:49:14,871 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 15:49:14,872 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 328, total: 442, max: 672
2015-05-20 15:49:14,872 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:14,872 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 15:49:14,873 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 328, total: 442, max: 672
2015-05-20 15:49:14,873 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:14,873 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 15:49:14,873 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 328, total: 442, max: 672
2015-05-20 15:49:14,873 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:14,874 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 15:49:14,874 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 328, total: 442, max: 672
2015-05-20 15:49:14,874 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:14,885 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 15:49:14,885 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 15:49:14,889 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(max)[by:[{1}:'char']]
2015-05-20 15:49:14,889 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'max']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/maxbynullsafety"]
2015-05-20 15:49:14,914 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/maxbynullsafety/_temporary
2015-05-20 15:49:14,956 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/assemblyhelpersplatform/maxbynullsafety
2015-05-20 15:49:14,968 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 15:49:14,968 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 15:49:14,976 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [sum] starting
2015-05-20 15:49:14,976 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [sum] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:14,976 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [sum] sink: Hfs["TextDelimited[['char', 'sum']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/sumnulls"]
2015-05-20 15:49:14,976 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [sum] parallel execution is enabled: false
2015-05-20 15:49:14,977 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [sum] starting jobs: 1
2015-05-20 15:49:14,977 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [sum] allocating threads: 1
2015-05-20 15:49:14,977 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [sum] starting step: (1/1) ...yhelpersplatform/sumnulls
2015-05-20 15:49:15,033 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi1815854987/.staging/job_local1815854987_0025/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:15,034 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi1815854987/.staging/job_local1815854987_0025/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:15,065 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local1815854987_0025/job_local1815854987_0025.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:15,065 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local1815854987_0025/job_local1815854987_0025.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:15,066 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [sum] submitted hadoop job: job_local1815854987_0025
2015-05-20 15:49:15,066 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [sum] tracking url: http://localhost:8080/
2015-05-20 15:49:15,069 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt
2015-05-20 15:49:15,085 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:15,085 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:15,088 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:15,088 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(sum)[by:[{1}:'char']]
2015-05-20 15:49:15,093 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 15:49:15,093 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 328, total: 443, max: 672
2015-05-20 15:49:15,093 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:15,094 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 15:49:15,094 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 328, total: 443, max: 672
2015-05-20 15:49:15,094 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:15,094 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 15:49:15,094 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 328, total: 443, max: 672
2015-05-20 15:49:15,095 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:15,095 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 15:49:15,095 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 328, total: 443, max: 672
2015-05-20 15:49:15,095 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 65% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:15,105 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 15:49:15,105 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 15:49:15,110 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(sum)[by:[{1}:'char']]
2015-05-20 15:49:15,111 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'sum']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/sumnulls"]
2015-05-20 15:49:15,137 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/sumnulls/_temporary
2015-05-20 15:49:15,179 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/assemblyhelpersplatform/sumnulls
2015-05-20 15:49:15,192 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 15:49:15,192 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 15:49:15,199 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] starting
2015-05-20 15:49:15,199 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:15,199 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] sink: Hfs["TextDelimited[['count']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/countall"]
2015-05-20 15:49:15,199 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] parallel execution is enabled: false
2015-05-20 15:49:15,199 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] starting jobs: 1
2015-05-20 15:49:15,199 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] allocating threads: 1
2015-05-20 15:49:15,200 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count] starting step: (1/1) ...yhelpersplatform/countall
2015-05-20 15:49:15,256 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi533761543/.staging/job_local533761543_0026/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:15,256 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi533761543/.staging/job_local533761543_0026/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:15,286 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local533761543_0026/job_local533761543_0026.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:15,287 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local533761543_0026/job_local533761543_0026.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:15,287 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count] submitted hadoop job: job_local533761543_0026
2015-05-20 15:49:15,288 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count] tracking url: http://localhost:8080/
2015-05-20 15:49:15,290 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt
2015-05-20 15:49:15,306 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:15,307 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:15,310 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:15,310 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(count)[by:[{?}:NONE]]
2015-05-20 15:49:15,322 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 15:49:15,323 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 15:49:15,327 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(count)[by:[{?}:NONE]]
2015-05-20 15:49:15,328 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['count']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/countall"]
2015-05-20 15:49:15,348 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/countall/_temporary
2015-05-20 15:49:15,393 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/assemblyhelpersplatform/countall
2015-05-20 15:49:15,405 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 15:49:15,406 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 15:49:15,414 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] starting
2015-05-20 15:49:15,415 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:15,415 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average', 'average2', 'first']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/multi"]
2015-05-20 15:49:15,415 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] parallel execution is enabled: false
2015-05-20 15:49:15,415 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] starting jobs: 1
2015-05-20 15:49:15,415 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] allocating threads: 1
2015-05-20 15:49:15,416 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [name] starting step: (1/1) ...mblyhelpersplatform/multi
2015-05-20 15:49:15,470 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi1594363265/.staging/job_local1594363265_0027/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:15,471 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi1594363265/.staging/job_local1594363265_0027/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:15,501 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local1594363265_0027/job_local1594363265_0027.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:15,502 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local1594363265_0027/job_local1594363265_0027.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:15,502 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [name] submitted hadoop job: job_local1594363265_0027
2015-05-20 15:49:15,502 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [name] tracking url: http://localhost:8080/
2015-05-20 15:49:15,505 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt
2015-05-20 15:49:15,520 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:15,520 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:15,525 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:15,525 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(name)[by:[{1}:'char']]
2015-05-20 15:49:15,526 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 15:49:15,526 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 329, total: 444, max: 672
2015-05-20 15:49:15,526 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 66% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:15,527 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 15:49:15,527 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 329, total: 444, max: 672
2015-05-20 15:49:15,527 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 66% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:15,528 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 15:49:15,528 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 329, total: 444, max: 672
2015-05-20 15:49:15,528 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 66% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:15,528 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 15:49:15,528 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 329, total: 444, max: 672
2015-05-20 15:49:15,529 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 66% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:15,539 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 15:49:15,539 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 15:49:15,544 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(name)[by:[{1}:'char']]
2015-05-20 15:49:15,544 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average', 'average2', 'first']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/multi"]
2015-05-20 15:49:15,571 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/multi/_temporary
2015-05-20 15:49:15,611 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/assemblyhelpersplatform/multi
2015-05-20 15:49:15,622 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 15:49:15,622 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 15:49:15,628 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] starting
2015-05-20 15:49:15,628 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt"]
2015-05-20 15:49:15,628 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] sink: Hfs["TextLine[['num']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/retainnarrow"]
2015-05-20 15:49:15,628 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] parallel execution is enabled: false
2015-05-20 15:49:15,628 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] starting jobs: 1
2015-05-20 15:49:15,628 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] allocating threads: 1
2015-05-20 15:49:15,629 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [shape] starting step: (1/1) ...persplatform/retainnarrow
2015-05-20 15:49:15,683 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi282112188/.staging/job_local282112188_0028/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:15,684 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi282112188/.staging/job_local282112188_0028/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:15,714 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local282112188_0028/job_local282112188_0028.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:15,715 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local282112188_0028/job_local282112188_0028.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:15,716 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [shape] submitted hadoop job: job_local282112188_0028
2015-05-20 15:49:15,716 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [shape] tracking url: http://localhost:8080/
2015-05-20 15:49:15,719 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt
2015-05-20 15:49:15,724 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:15,724 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:15,727 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt"]
2015-05-20 15:49:15,727 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['num']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/retainnarrow"]
2015-05-20 15:49:15,740 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/retainnarrow/_temporary
2015-05-20 15:49:15,761 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/assemblyhelpersplatform/retainnarrow
2015-05-20 15:49:15,771 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 15:49:15,771 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 15:49:15,777 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] starting
2015-05-20 15:49:15,777 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt"]
2015-05-20 15:49:15,777 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] sink: Hfs["TextLine[['item']->['char', 'item']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/renamenarrow"]
2015-05-20 15:49:15,777 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] parallel execution is enabled: false
2015-05-20 15:49:15,778 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] starting jobs: 1
2015-05-20 15:49:15,778 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] allocating threads: 1
2015-05-20 15:49:15,778 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [shape] starting step: (1/1) ...persplatform/renamenarrow
2015-05-20 15:49:15,835 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi375569883/.staging/job_local375569883_0029/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:15,836 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi375569883/.staging/job_local375569883_0029/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:15,866 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local375569883_0029/job_local375569883_0029.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:15,867 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local375569883_0029/job_local375569883_0029.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:15,868 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [shape] submitted hadoop job: job_local375569883_0029
2015-05-20 15:49:15,868 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [shape] tracking url: http://localhost:8080/
2015-05-20 15:49:15,871 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt
2015-05-20 15:49:15,877 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:15,877 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:15,879 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt"]
2015-05-20 15:49:15,879 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['item']->['char', 'item']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/renamenarrow"]
2015-05-20 15:49:15,894 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/renamenarrow/_temporary
2015-05-20 15:49:15,914 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/assemblyhelpersplatform/renamenarrow
2015-05-20 15:49:15,926 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 15:49:15,927 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 15:49:15,933 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [average] starting
2015-05-20 15:49:15,934 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [average] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:15,934 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [average] sink: Hfs["TextDelimited[['char', 'average']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/averagenull"]
2015-05-20 15:49:15,934 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [average] parallel execution is enabled: false
2015-05-20 15:49:15,934 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [average] starting jobs: 1
2015-05-20 15:49:15,934 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [average] allocating threads: 1
2015-05-20 15:49:15,935 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [average] starting step: (1/1) ...lpersplatform/averagenull
2015-05-20 15:49:15,996 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi2104998305/.staging/job_local2104998305_0030/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:15,997 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi2104998305/.staging/job_local2104998305_0030/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:16,024 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local2104998305_0030/job_local2104998305_0030.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:16,025 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local2104998305_0030/job_local2104998305_0030.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:16,026 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [average] submitted hadoop job: job_local2104998305_0030
2015-05-20 15:49:16,026 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [average] tracking url: http://localhost:8080/
2015-05-20 15:49:16,029 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt
2015-05-20 15:49:16,041 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:16,041 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:16,044 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:16,045 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(average)[by:[{1}:'char']]
2015-05-20 15:49:16,047 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 15:49:16,047 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 306, total: 444, max: 672
2015-05-20 15:49:16,047 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 66% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:16,048 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 15:49:16,048 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 306, total: 444, max: 672
2015-05-20 15:49:16,048 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 66% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:16,049 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 15:49:16,049 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 306, total: 444, max: 672
2015-05-20 15:49:16,049 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 66% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:16,050 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 15:49:16,050 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 306, total: 444, max: 672
2015-05-20 15:49:16,050 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 66% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:16,064 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 15:49:16,064 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 15:49:16,068 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(average)[by:[{1}:'char']]
2015-05-20 15:49:16,069 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'average']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/averagenull"]
2015-05-20 15:49:16,099 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/averagenull/_temporary
2015-05-20 15:49:16,143 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/assemblyhelpersplatform/averagenull
2015-05-20 15:49:16,153 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 15:49:16,154 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 15:49:16,159 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [coerce] starting
2015-05-20 15:49:16,160 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [coerce] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt"]
2015-05-20 15:49:16,160 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [coerce] sink: Hfs["TextLine[['line']->['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/coerce"]
2015-05-20 15:49:16,160 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [coerce] parallel execution is enabled: false
2015-05-20 15:49:16,160 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [coerce] starting jobs: 1
2015-05-20 15:49:16,160 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [coerce] allocating threads: 1
2015-05-20 15:49:16,161 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [coerce] starting step: (1/1) ...blyhelpersplatform/coerce
2015-05-20 15:49:16,220 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi890195198/.staging/job_local890195198_0031/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:16,221 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi890195198/.staging/job_local890195198_0031/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:16,257 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local890195198_0031/job_local890195198_0031.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:16,258 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local890195198_0031/job_local890195198_0031.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:16,258 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [coerce] submitted hadoop job: job_local890195198_0031
2015-05-20 15:49:16,259 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [coerce] tracking url: http://localhost:8080/
2015-05-20 15:49:16,261 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt
2015-05-20 15:49:16,267 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:16,267 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:16,269 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt"]
2015-05-20 15:49:16,269 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['line']->['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/coerce"]
2015-05-20 15:49:16,295 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/coerce/_temporary
2015-05-20 15:49:16,317 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/assemblyhelpersplatform/coerce
2015-05-20 15:49:16,328 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 15:49:16,328 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 15:49:16,336 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [first] starting
2015-05-20 15:49:16,337 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [first] source: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs+rhs-cross-rev.txt"]
2015-05-20 15:49:16,337 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [first] sink: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/firstnfieldswithoutcomparator"]
2015-05-20 15:49:16,337 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [first] parallel execution is enabled: false
2015-05-20 15:49:16,337 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [first] starting jobs: 1
2015-05-20 15:49:16,337 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [first] allocating threads: 1
2015-05-20 15:49:16,338 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [first] starting step: (1/1) ...tnfieldswithoutcomparator
2015-05-20 15:49:16,393 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi2011407083/.staging/job_local2011407083_0032/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:16,394 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi2011407083/.staging/job_local2011407083_0032/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:16,420 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local2011407083_0032/job_local2011407083_0032.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:16,421 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local2011407083_0032/job_local2011407083_0032.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:16,422 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [first] submitted hadoop job: job_local2011407083_0032
2015-05-20 15:49:16,422 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [first] tracking url: http://localhost:8080/
2015-05-20 15:49:16,428 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs+rhs-cross-rev.txt
2015-05-20 15:49:16,440 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:16,440 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:16,443 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs+rhs-cross-rev.txt"]
2015-05-20 15:49:16,443 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(first)[by:[{1}:'num']]
2015-05-20 15:49:16,445 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 15:49:16,445 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 329, total: 445, max: 672
2015-05-20 15:49:16,445 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 66% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:16,446 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 15:49:16,446 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 329, total: 445, max: 672
2015-05-20 15:49:16,446 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 66% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:16,456 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 15:49:16,456 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 15:49:16,459 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(first)[by:[{1}:'num']]
2015-05-20 15:49:16,459 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['num', 'lower', 'upper']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/firstnfieldswithoutcomparator"]
2015-05-20 15:49:16,484 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/firstnfieldswithoutcomparator/_temporary
2015-05-20 15:49:16,504 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/assemblyhelpersplatform/firstnfieldswithoutcomparator
2015-05-20 15:49:16,515 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 15:49:16,516 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 15:49:16,525 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] starting
2015-05-20 15:49:16,525 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs.txt"]
2015-05-20 15:49:16,525 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:16,525 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] sink: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/multimerge+false638"]
2015-05-20 15:49:16,525 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] parallel execution is enabled: false
2015-05-20 15:49:16,525 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] starting jobs: 1
2015-05-20 15:49:16,525 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [name] allocating threads: 1
2015-05-20 15:49:16,526 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [name] starting step: (1/1) ...tform/multimerge+false638
2015-05-20 15:49:16,581 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi407805262/.staging/job_local407805262_0033/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:16,582 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi407805262/.staging/job_local407805262_0033/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:16,610 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local407805262_0033/job_local407805262_0033.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:16,611 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local407805262_0033/job_local407805262_0033.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:16,611 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [name] submitted hadoop job: job_local407805262_0033
2015-05-20 15:49:16,611 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [name] tracking url: http://localhost:8080/
2015-05-20 15:49:16,614 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt
2015-05-20 15:49:16,629 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:16,629 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:16,634 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:16,635 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2015-05-20 15:49:16,636 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 15:49:16,636 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 331, total: 446, max: 672
2015-05-20 15:49:16,636 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 66% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:16,636 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 15:49:16,636 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 331, total: 446, max: 672
2015-05-20 15:49:16,636 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 66% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:16,637 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 15:49:16,637 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 331, total: 446, max: 672
2015-05-20 15:49:16,637 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 66% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:16,637 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 15:49:16,638 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 331, total: 446, max: 672
2015-05-20 15:49:16,638 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 66% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:16,643 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs.txt
2015-05-20 15:49:16,656 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:16,656 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:16,660 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs.txt"]
2015-05-20 15:49:16,660 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2015-05-20 15:49:16,663 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 15:49:16,663 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 229, total: 446, max: 672
2015-05-20 15:49:16,663 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 66% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:16,664 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 15:49:16,664 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 229, total: 446, max: 672
2015-05-20 15:49:16,664 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 66% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:16,664 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 15:49:16,665 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 229, total: 446, max: 672
2015-05-20 15:49:16,665 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 66% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:16,665 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 15:49:16,665 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 229, total: 446, max: 672
2015-05-20 15:49:16,666 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 66% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:16,678 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 15:49:16,679 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 15:49:16,683 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(name)[by: multi-lhs:[{1}:'char'] multi-rhs:[{1}:'char']]
2015-05-20 15:49:16,683 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'sum', 'count', 'average']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/multimerge+false638"]
2015-05-20 15:49:16,705 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/multimerge+false638/_temporary
2015-05-20 15:49:16,749 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/assemblyhelpersplatform/multimerge+false638
2015-05-20 15:49:16,763 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 15:49:16,763 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 15:49:16,794 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count-lhs*source*count...] starting
2015-05-20 15:49:16,794 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count-lhs*source*count...] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:16,794 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count-lhs*source*count...] sink: Hfs["TextDelimited[['char', 'count']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/samesourcemergethreeway"]
2015-05-20 15:49:16,794 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count-lhs*source*count...] parallel execution is enabled: false
2015-05-20 15:49:16,794 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count-lhs*source*count...] starting jobs: 5
2015-05-20 15:49:16,795 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count-lhs*source*count...] allocating threads: 1
2015-05-20 15:49:16,795 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count-lhs*source*count...] starting step: (1/5)
2015-05-20 15:49:16,850 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi2065948829/.staging/job_local2065948829_0034/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:16,851 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi2065948829/.staging/job_local2065948829_0034/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:16,880 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local2065948829_0034/job_local2065948829_0034.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:16,881 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local2065948829_0034/job_local2065948829_0034.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:16,882 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count-lhs*source*count...] submitted hadoop job: job_local2065948829_0034
2015-05-20 15:49:16,882 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2015-05-20 15:49:16,885 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt
2015-05-20 15:49:16,897 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:16,898 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:16,901 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:16,901 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(source)[by:[{1}:'char']]
2015-05-20 15:49:16,902 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 15:49:16,902 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 294, total: 446, max: 672
2015-05-20 15:49:16,902 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 66% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:16,902 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 15:49:16,903 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 294, total: 446, max: 672
2015-05-20 15:49:16,903 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 66% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:16,903 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 5, with capacity: 2
2015-05-20 15:49:16,903 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 294, total: 446, max: 672
2015-05-20 15:49:16,903 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 66% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:16,903 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 7, with capacity: 2
2015-05-20 15:49:16,903 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 294, total: 446, max: 672
2015-05-20 15:49:16,904 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 66% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:16,914 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 15:49:16,914 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 15:49:16,917 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(source)[by:[{1}:'char']]
2015-05-20 15:49:16,917 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: TempHfs["SequenceFile[['char', 'count']]"][2584412820/source/]
2015-05-20 15:49:16,942 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count-lhs*source*count...] starting step: (3/5)
2015-05-20 15:49:17,010 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi481320158/.staging/job_local481320158_0035/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:17,011 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi481320158/.staging/job_local481320158_0035/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:17,038 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local481320158_0035/job_local481320158_0035.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:17,039 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local481320158_0035/job_local481320158_0035.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:17,040 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count-lhs*source*count...] submitted hadoop job: job_local481320158_0035
2015-05-20 15:49:17,040 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2015-05-20 15:49:17,042 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-soberoi/2584412820_source_94DCCA54A4BC45D58FCE25B2EB12B6E0/part-00000
2015-05-20 15:49:17,057 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:17,057 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:17,061 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][2584412820/source/]
2015-05-20 15:49:17,061 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(count-lhs)[by:[{1}:'char']]
2015-05-20 15:49:17,061 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 15:49:17,062 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 329, total: 446, max: 672
2015-05-20 15:49:17,062 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 66% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:17,062 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 15:49:17,062 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 329, total: 446, max: 672
2015-05-20 15:49:17,062 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 66% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:17,073 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 15:49:17,073 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 15:49:17,077 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(count-lhs)[by:[{1}:'char']]
2015-05-20 15:49:17,078 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: TempHfs["SequenceFile[['char', 'count']]"][8040875081/count-lhs/]
2015-05-20 15:49:17,099 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count-lhs*source*count...] starting step: (4/5)
2015-05-20 15:49:17,168 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi410393399/.staging/job_local410393399_0036/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:17,168 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi410393399/.staging/job_local410393399_0036/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:17,198 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local410393399_0036/job_local410393399_0036.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:17,199 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local410393399_0036/job_local410393399_0036.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:17,200 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count-lhs*source*count...] submitted hadoop job: job_local410393399_0036
2015-05-20 15:49:17,200 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2015-05-20 15:49:17,203 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-soberoi/2584412820_source_94DCCA54A4BC45D58FCE25B2EB12B6E0/part-00000
2015-05-20 15:49:17,217 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:17,217 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:17,220 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][2584412820/source/]
2015-05-20 15:49:17,220 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(count-rhs)[by:[{1}:'char']]
2015-05-20 15:49:17,221 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 15:49:17,221 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 330, total: 446, max: 672
2015-05-20 15:49:17,221 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 66% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:17,222 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 15:49:17,222 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 330, total: 446, max: 672
2015-05-20 15:49:17,222 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 66% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:49:17,231 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 15:49:17,231 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 15:49:17,234 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(count-rhs)[by:[{1}:'char']]
2015-05-20 15:49:17,234 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: TempHfs["SequenceFile[['char', 'count']]"][9796321191/count-rhs/]
2015-05-20 15:49:17,254 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count-lhs*source*count...] starting step: (2/5)
2015-05-20 15:49:17,332 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi417167314/.staging/job_local417167314_0037/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:17,333 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi417167314/.staging/job_local417167314_0037/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:17,361 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local417167314_0037/job_local417167314_0037.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:17,362 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local417167314_0037/job_local417167314_0037.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:17,363 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count-lhs*source*count...] submitted hadoop job: job_local417167314_0037
2015-05-20 15:49:17,363 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2015-05-20 15:49:17,366 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-soberoi/2584412820_source_94DCCA54A4BC45D58FCE25B2EB12B6E0/part-00000
2015-05-20 15:49:17,381 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:17,381 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:17,385 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][2584412820/source/]
2015-05-20 15:49:17,385 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: CoGroup(source*count-rhs)[by: source:[{1}:'char'] count-rhs:[{1}:'char']]
2015-05-20 15:49:17,391 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-soberoi/9796321191_count_rhs_5D7029AFDE9B434B9F3E080109B7D534/part-00000
2015-05-20 15:49:17,403 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:17,403 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:17,406 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][9796321191/count-rhs/]
2015-05-20 15:49:17,406 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: CoGroup(source*count-rhs)[by: source:[{1}:'char'] count-rhs:[{1}:'char']]
2015-05-20 15:49:17,416 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 15:49:17,417 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 15:49:17,420 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: CoGroup(source*count-rhs)[by: source:[{1}:'char'] count-rhs:[{1}:'char']]
2015-05-20 15:49:17,420 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: TempHfs["SequenceFile[['char', 'num', 'char2', 'count']]"][6463971686/source_count-rhs/]
2015-05-20 15:49:17,429 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-05-20 15:49:17,429 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2015-05-20 15:49:17,446 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count-lhs*source*count...] starting step: (5/5) ...m/samesourcemergethreeway
2015-05-20 15:49:17,522 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi1409632063/.staging/job_local1409632063_0038/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:17,523 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi1409632063/.staging/job_local1409632063_0038/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:17,556 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local1409632063_0038/job_local1409632063_0038.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:17,557 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local1409632063_0038/job_local1409632063_0038.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:17,558 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count-lhs*source*count...] submitted hadoop job: job_local1409632063_0038
2015-05-20 15:49:17,558 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count-lhs*source*count...] tracking url: http://localhost:8080/
2015-05-20 15:49:17,561 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-soberoi/6463971686_source_count_rhs_3B37C32BB2894291A97B0FF54449A62D/part-00000
2015-05-20 15:49:17,573 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:17,574 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:17,578 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: TempHfs["SequenceFile[['char', 'num', 'char2', 'count']]"][6463971686/source_count-rhs/]
2015-05-20 15:49:17,578 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: CoGroup(count-lhs*source*count-rhs)[by: count-lhs:[{1}:'char'] source*count-rhs:[{1}:'char']]
2015-05-20 15:49:17,583 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/tmp/hadoop-soberoi/8040875081_count_lhs_6FC0B194BF154EE1B99125613F670681/part-00000
2015-05-20 15:49:17,596 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:17,596 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:17,599 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: TempHfs["SequenceFile[['char', 'count']]"][8040875081/count-lhs/]
2015-05-20 15:49:17,599 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: CoGroup(count-lhs*source*count-rhs)[by: count-lhs:[{1}:'char'] source*count-rhs:[{1}:'char']]
2015-05-20 15:49:17,610 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 15:49:17,610 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 15:49:17,614 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: CoGroup(count-lhs*source*count-rhs)[by: count-lhs:[{1}:'char'] source*count-rhs:[{1}:'char']]
2015-05-20 15:49:17,614 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['char', 'count']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/samesourcemergethreeway"]
2015-05-20 15:49:17,620 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(105)) - attempting to load codec: org.apache.hadoop.io.compress.GzipCodec
2015-05-20 15:49:17,620 INFO collect.SpillableTupleList (SpillableTupleList.java:getCodecClass(110)) - found codec: org.apache.hadoop.io.compress.GzipCodec
2015-05-20 15:49:17,644 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/samesourcemergethreeway/_temporary
2015-05-20 15:49:17,683 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/assemblyhelpersplatform/samesourcemergethreeway
2015-05-20 15:49:17,697 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 15:49:17,698 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 15:49:17,707 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [lhs+rhs] starting
2015-05-20 15:49:17,707 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [lhs+rhs] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs.txt"]
2015-05-20 15:49:17,707 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [lhs+rhs] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:17,707 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [lhs+rhs] sink: Hfs["TextLine[['item']->['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/uniquemerge-nondeterministic"]
2015-05-20 15:49:17,707 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [lhs+rhs] parallel execution is enabled: false
2015-05-20 15:49:17,707 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [lhs+rhs] starting jobs: 1
2015-05-20 15:49:17,707 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [lhs+rhs] allocating threads: 1
2015-05-20 15:49:17,708 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [lhs+rhs] starting step: (1/1) ...quemerge-nondeterministic
2015-05-20 15:49:17,764 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi1698732500/.staging/job_local1698732500_0039/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:17,765 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi1698732500/.staging/job_local1698732500_0039/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:17,792 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local1698732500_0039/job_local1698732500_0039.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:17,793 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local1698732500_0039/job_local1698732500_0039.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:17,794 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [lhs+rhs] submitted hadoop job: job_local1698732500_0039
2015-05-20 15:49:17,794 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [lhs+rhs] tracking url: http://localhost:8080/
2015-05-20 15:49:17,797 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt
2015-05-20 15:49:17,809 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:17,809 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:17,812 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:17,812 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(lhs+rhs)[by: lhs:[{1}:'num'] rhs:[{1}:'num']]
2015-05-20 15:49:17,821 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs.txt
2015-05-20 15:49:17,836 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:17,836 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:17,839 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/rhs.txt"]
2015-05-20 15:49:17,839 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(lhs+rhs)[by: lhs:[{1}:'num'] rhs:[{1}:'num']]
2015-05-20 15:49:17,852 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 15:49:17,853 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 15:49:17,856 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(lhs+rhs)[by: lhs:[{1}:'num'] rhs:[{1}:'num']]
2015-05-20 15:49:17,856 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['item']->['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/uniquemerge-nondeterministic"]
2015-05-20 15:49:17,877 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/uniquemerge-nondeterministic/_temporary
2015-05-20 15:49:17,898 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/assemblyhelpersplatform/uniquemerge-nondeterministic
2015-05-20 15:49:17,909 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 15:49:17,910 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 15:49:17,917 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] starting
2015-05-20 15:49:17,917 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:17,917 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] sink: Hfs["TextLine[['item']->['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/unique"]
2015-05-20 15:49:17,917 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] parallel execution is enabled: false
2015-05-20 15:49:17,917 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] starting jobs: 1
2015-05-20 15:49:17,918 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [shape] allocating threads: 1
2015-05-20 15:49:17,918 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [shape] starting step: (1/1) ...blyhelpersplatform/unique
2015-05-20 15:49:17,976 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi1669301419/.staging/job_local1669301419_0040/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:17,977 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi1669301419/.staging/job_local1669301419_0040/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:18,006 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local1669301419_0040/job_local1669301419_0040.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:18,007 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local1669301419_0040/job_local1669301419_0040.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:18,007 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [shape] submitted hadoop job: job_local1669301419_0040
2015-05-20 15:49:18,008 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [shape] tracking url: http://localhost:8080/
2015-05-20 15:49:18,010 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt
2015-05-20 15:49:18,025 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:18,025 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:18,027 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:18,028 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(shape)[by:[{1}:'num']]
2015-05-20 15:49:18,038 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 15:49:18,039 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 15:49:18,041 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(shape)[by:[{1}:'num']]
2015-05-20 15:49:18,041 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['item']->['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/unique"]
2015-05-20 15:49:18,068 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/unique/_temporary
2015-05-20 15:49:18,088 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/assemblyhelpersplatform/unique
2015-05-20 15:49:18,102 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 15:49:18,102 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 15:49:18,110 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] starting
2015-05-20 15:49:18,110 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:18,111 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] sink: Hfs["TextDelimited[['notnull', 'null']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/countnullnotnull"]
2015-05-20 15:49:18,111 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] parallel execution is enabled: false
2015-05-20 15:49:18,111 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] starting jobs: 1
2015-05-20 15:49:18,111 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [count] allocating threads: 1
2015-05-20 15:49:18,111 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count] starting step: (1/1) ...platform/countnullnotnull
2015-05-20 15:49:18,167 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi901923999/.staging/job_local901923999_0041/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:18,168 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi901923999/.staging/job_local901923999_0041/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:18,197 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local901923999_0041/job_local901923999_0041.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 15:49:18,198 WARN conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local901923999_0041/job_local901923999_0041.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 15:49:18,198 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count] submitted hadoop job: job_local901923999_0041
2015-05-20 15:49:18,198 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [count] tracking url: http://localhost:8080/
2015-05-20 15:49:18,201 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt
2015-05-20 15:49:18,215 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:49:18,215 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:49:18,219 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lhs.txt"]
2015-05-20 15:49:18,219 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(count)[by:[{?}:NONE]]
2015-05-20 15:49:18,231 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 15:49:18,231 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 15:49:18,235 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(count)[by:[{?}:NONE]]
2015-05-20 15:49:18,235 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextDelimited[['notnull', 'null']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/countnullnotnull"]
2015-05-20 15:49:18,257 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/assemblyhelpersplatform/countnullnotnull/_temporary
2015-05-20 15:49:18,298 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/assemblyhelpersplatform/countnullnotnull