2015-05-20 20:13:21,293 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(187)) - found 1 test platforms from classpath
2015-05-20 20:13:21,325 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(237)) - installing platform: hadoop2-mr1
2015-05-20 20:13:21,325 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(238)) - running test: cascading.function.FunctionPlatformTest
2015-05-20 20:13:21,340 INFO hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(105)) - not using cluster
2015-05-20 20:13:21,790 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2015-05-20 20:13:21,906 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 20:13:21,906 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 219, total: 245, max: 672
2015-05-20 20:13:21,907 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 36% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:21,907 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 20:13:21,907 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 219, total: 245, max: 672
2015-05-20 20:13:21,907 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 36% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:21,968 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:13:21,969 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:13:21,979 INFO property.AppProps (AppProps.java:getAppID(169)) - using app.id: 038BB5C820C94BE2B70936CF725648D9
2015-05-20 20:13:22,145 INFO util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 2.7.0
2015-05-20 20:13:22,146 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [formatter] starting
2015-05-20 20:13:22,148 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [formatter] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-05-20 20:13:22,148 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [formatter] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/functionplatform/formatter"]
2015-05-20 20:13:22,148 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [formatter] parallel execution is enabled: false
2015-05-20 20:13:22,149 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [formatter] starting jobs: 1
2015-05-20 20:13:22,149 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [formatter] allocating threads: 1
2015-05-20 20:13:22,150 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [formatter] starting step: (1/1) ...unctionplatform/formatter
2015-05-20 20:13:22,570 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi1098223796/.staging/job_local1098223796_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:22,580 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi1098223796/.staging/job_local1098223796_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:22,677 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local1098223796_0001/job_local1098223796_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:22,677 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local1098223796_0001/job_local1098223796_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:22,685 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [formatter] submitted hadoop job: job_local1098223796_0001
2015-05-20 20:13:22,685 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [formatter] tracking url: http://localhost:8080/
2015-05-20 20:13:22,740 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt
2015-05-20 20:13:22,761 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:22,761 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:22,785 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-05-20 20:13:22,786 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/functionplatform/formatter"]
2015-05-20 20:13:22,833 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/functionplatform/formatter/_temporary
2015-05-20 20:13:22,899 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/functionplatform/formatter
2015-05-20 20:13:22,902 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 20:13:22,902 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 207, total: 245, max: 672
2015-05-20 20:13:22,903 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 36% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:22,903 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 20:13:22,903 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 207, total: 245, max: 672
2015-05-20 20:13:22,904 INFO cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 36% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 20:13:22,933 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:13:22,934 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:13:22,964 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [apache] starting
2015-05-20 20:13:22,965 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [apache] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.200.txt"]
2015-05-20 20:13:22,965 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [apache] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/functionplatform/insert"]
2015-05-20 20:13:22,965 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [apache] parallel execution is enabled: false
2015-05-20 20:13:22,965 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [apache] starting jobs: 1
2015-05-20 20:13:22,965 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [apache] allocating threads: 1
2015-05-20 20:13:22,966 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [apache] starting step: (1/1) ...1/functionplatform/insert
2015-05-20 20:13:23,053 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi159121805/.staging/job_local159121805_0002/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:23,056 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi159121805/.staging/job_local159121805_0002/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:23,105 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local159121805_0002/job_local159121805_0002.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:23,105 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local159121805_0002/job_local159121805_0002.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:23,107 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [apache] submitted hadoop job: job_local159121805_0002
2015-05-20 20:13:23,107 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [apache] tracking url: http://localhost:8080/
2015-05-20 20:13:23,112 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.200.txt
2015-05-20 20:13:23,179 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:23,179 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:23,189 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.200.txt"]
2015-05-20 20:13:23,189 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(apache)[by:[{1}:'A']]
2015-05-20 20:13:23,229 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 20:13:23,229 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 20:13:23,237 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(apache)[by:[{1}:'A']]
2015-05-20 20:13:23,237 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/functionplatform/insert"]
2015-05-20 20:13:23,290 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/functionplatform/insert/_temporary
2015-05-20 20:13:23,355 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/functionplatform/insert
2015-05-20 20:13:23,374 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:13:23,374 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:13:23,399 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [setvalue] starting
2015-05-20 20:13:23,399 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [setvalue] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-05-20 20:13:23,399 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [setvalue] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/functionplatform/setvalue"]
2015-05-20 20:13:23,399 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [setvalue] parallel execution is enabled: false
2015-05-20 20:13:23,399 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [setvalue] starting jobs: 1
2015-05-20 20:13:23,399 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [setvalue] allocating threads: 1
2015-05-20 20:13:23,400 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [setvalue] starting step: (1/1) ...functionplatform/setvalue
2015-05-20 20:13:23,527 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi968367624/.staging/job_local968367624_0003/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:23,531 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi968367624/.staging/job_local968367624_0003/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:23,620 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local968367624_0003/job_local968367624_0003.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-05-20 20:13:23,621 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local968367624_0003/job_local968367624_0003.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-05-20 20:13:23,623 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [setvalue] submitted hadoop job: job_local968367624_0003
2015-05-20 20:13:23,624 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [setvalue] tracking url: http://localhost:8080/
2015-05-20 20:13:23,628 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt
2015-05-20 20:13:23,638 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:13:23,639 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 20:13:23,644 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-05-20 20:13:23,644 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/functionplatform/setvalue"]
2015-05-20 20:13:23,673 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/functionplatform/setvalue/_temporary
2015-05-20 20:13:23,733 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/functionplatform/setvalue