Class cascading.function.FunctionPlatformTest

5

tests

0

failures

0

ignored

2.504s

duration

100%

successful

Tests

Test Duration Result
testFieldFormatter 1.022s passed
testInsert 0.541s passed
testPartialCounts 0.579s passed
testPartialSums 0.002s passed
testSetValue 0.360s passed

Standard output

2015-05-20 15:48:52,272 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(187)) - found 1 test platforms from classpath
2015-05-20 15:48:52,305 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(237)) - installing platform: hadoop2-mr1
2015-05-20 15:48:52,305 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(238)) - running test: cascading.function.FunctionPlatformTest
2015-05-20 15:48:52,320 INFO  hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(105)) - not using cluster
2015-05-20 15:48:52,775 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2015-05-20 15:48:52,895 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 15:48:52,896 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 216, total: 245, max: 672
2015-05-20 15:48:52,896 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 36% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:48:52,896 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 15:48:52,897 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 216, total: 245, max: 672
2015-05-20 15:48:52,897 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 36% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:48:52,971 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 15:48:52,972 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 15:48:52,982 INFO  property.AppProps (AppProps.java:getAppID(169)) - using app.id: AC60FB861C0D420299F9022F691D9098
2015-05-20 15:48:53,162 INFO  util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 2.7.0
2015-05-20 15:48:53,163 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [formatter] starting
2015-05-20 15:48:53,164 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [formatter]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt"]
2015-05-20 15:48:53,165 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [formatter]  sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/functionplatform/formatter"]
2015-05-20 15:48:53,165 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [formatter]  parallel execution is enabled: false
2015-05-20 15:48:53,165 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [formatter]  starting jobs: 1
2015-05-20 15:48:53,165 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [formatter]  allocating threads: 1
2015-05-20 15:48:53,167 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [formatter] starting step: (1/1) ...unctionplatform/formatter
2015-05-20 15:48:53,596 WARN  conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi508889995/.staging/job_local508889995_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-05-20 15:48:53,602 WARN  conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi508889995/.staging/job_local508889995_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-05-20 15:48:53,702 WARN  conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local508889995_0001/job_local508889995_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-05-20 15:48:53,706 WARN  conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local508889995_0001/job_local508889995_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-05-20 15:48:53,713 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [formatter] submitted hadoop job: job_local508889995_0001
2015-05-20 15:48:53,713 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [formatter] tracking url: http://localhost:8080/
2015-05-20 15:48:53,755 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt
2015-05-20 15:48:53,777 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:48:53,777 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:48:53,805 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt"]
2015-05-20 15:48:53,805 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/functionplatform/formatter"]
2015-05-20 15:48:53,852 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/functionplatform/formatter/_temporary
2015-05-20 15:48:53,921 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/functionplatform/formatter
2015-05-20 15:48:53,923 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-05-20 15:48:53,923 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 256, total: 310, max: 672
2015-05-20 15:48:53,923 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 46% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:48:53,924 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-05-20 15:48:53,924 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 256, total: 310, max: 672
2015-05-20 15:48:53,924 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 46% of max mem, to better utilize unused memory consider increasing the cache size
2015-05-20 15:48:53,958 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 15:48:53,959 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 15:48:53,987 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [apache] starting
2015-05-20 15:48:53,988 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [apache]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/apache.200.txt"]
2015-05-20 15:48:53,988 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [apache]  sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/functionplatform/insert"]
2015-05-20 15:48:53,988 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [apache]  parallel execution is enabled: false
2015-05-20 15:48:53,988 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [apache]  starting jobs: 1
2015-05-20 15:48:53,988 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [apache]  allocating threads: 1
2015-05-20 15:48:53,989 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [apache] starting step: (1/1) ...1/functionplatform/insert
2015-05-20 15:48:54,080 WARN  conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi1103496039/.staging/job_local1103496039_0002/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-05-20 15:48:54,083 WARN  conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi1103496039/.staging/job_local1103496039_0002/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-05-20 15:48:54,143 WARN  conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local1103496039_0002/job_local1103496039_0002.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-05-20 15:48:54,145 WARN  conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local1103496039_0002/job_local1103496039_0002.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-05-20 15:48:54,146 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [apache] submitted hadoop job: job_local1103496039_0002
2015-05-20 15:48:54,146 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [apache] tracking url: http://localhost:8080/
2015-05-20 15:48:54,151 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/apache.200.txt
2015-05-20 15:48:54,216 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:48:54,216 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:48:54,229 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/apache.200.txt"]
2015-05-20 15:48:54,230 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(apache)[by:[{1}:'A']]
2015-05-20 15:48:54,335 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.7.0
2015-05-20 15:48:54,335 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-05-20 15:48:54,342 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(apache)[by:[{1}:'A']]
2015-05-20 15:48:54,343 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/functionplatform/insert"]
2015-05-20 15:48:54,393 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/functionplatform/insert/_temporary
2015-05-20 15:48:54,466 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/functionplatform/insert
2015-05-20 15:48:54,490 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 15:48:54,491 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 15:48:54,511 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [setvalue] starting
2015-05-20 15:48:54,511 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [setvalue]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt"]
2015-05-20 15:48:54,512 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [setvalue]  sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/functionplatform/setvalue"]
2015-05-20 15:48:54,512 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [setvalue]  parallel execution is enabled: false
2015-05-20 15:48:54,512 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [setvalue]  starting jobs: 1
2015-05-20 15:48:54,512 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [setvalue]  allocating threads: 1
2015-05-20 15:48:54,512 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [setvalue] starting step: (1/1) ...functionplatform/setvalue
2015-05-20 15:48:54,667 WARN  conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi1818892769/.staging/job_local1818892769_0003/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-05-20 15:48:54,670 WARN  conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi1818892769/.staging/job_local1818892769_0003/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-05-20 15:48:54,731 WARN  conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local1818892769_0003/job_local1818892769_0003.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-05-20 15:48:54,732 WARN  conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local1818892769_0003/job_local1818892769_0003.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-05-20 15:48:54,732 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [setvalue] submitted hadoop job: job_local1818892769_0003
2015-05-20 15:48:54,733 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [setvalue] tracking url: http://localhost:8080/
2015-05-20 15:48:54,738 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt
2015-05-20 15:48:54,748 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 15:48:54,748 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-05-20 15:48:54,753 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt"]
2015-05-20 15:48:54,754 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/functionplatform/setvalue"]
2015-05-20 15:48:54,778 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/functionplatform/setvalue/_temporary
2015-05-20 15:48:54,827 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/functionplatform/setvalue