Class cascading.function.FunctionPlatformTest

5

tests

0

failures

0

ignored

3.367s

duration

100%

successful

Tests

Test Duration Result
testFieldFormatter 1.467s passed
testInsert 0.646s passed
testPartialCounts 0.789s passed
testPartialSums 0.004s passed
testSetValue 0.461s passed

Standard output

2015-07-21 12:23:19,121 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(195)) - found 1 test platforms from classpath
2015-07-21 12:23:19,139 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(244)) - adding test: cascading.function.FunctionPlatformTest, with platform: hadoop2-mr1
2015-07-21 12:23:19,156 INFO  hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(119)) - not using cluster
2015-07-21 12:23:19,769 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2015-07-21 12:23:19,894 INFO  platform.TestPlatform (TestPlatform.java:getGlobalProperties(73)) - platform property overrides: 
2015-07-21 12:23:19,940 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-07-21 12:23:19,941 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 203, total: 245, max: 672
2015-07-21 12:23:19,941 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 36% of max mem, to better utilize unused memory consider increasing the cache size
2015-07-21 12:23:19,942 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-07-21 12:23:19,942 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 203, total: 245, max: 672
2015-07-21 12:23:19,942 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 36% of max mem, to better utilize unused memory consider increasing the cache size
2015-07-21 12:23:20,025 INFO  util.Util (Util.java:findMainClass(1325)) - using default application jar, may cause class not found exceptions on the cluster
2015-07-21 12:23:20,027 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /Users/castillo/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.1/616db6028856ef10fd9ffb4ebd59ea94589475c4/cascading-hadoop2-mr1-3.0.1.jar
2015-07-21 12:23:20,125 INFO  property.AppProps (AppProps.java:getAppID(174)) - using app.id: 3FA8551864864DD888B943B75E5361D7
2015-07-21 12:23:20,289 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [formatter] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.095
2015-07-21 12:23:20,291 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [formatter] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2015-07-21 12:23:20,292 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [formatter] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-07-21 12:23:20,479 INFO  util.Version (Version.java:printBanner(81)) - Concurrent, Inc - Cascading 3.0.1
2015-07-21 12:23:20,480 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [formatter] starting
2015-07-21 12:23:20,480 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [formatter]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/classes/test/data/upper.txt"]
2015-07-21 12:23:20,481 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [formatter]  sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/functionplatform/testFieldFormatter/formatter"]
2015-07-21 12:23:20,481 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [formatter]  parallel execution of steps is enabled: false
2015-07-21 12:23:20,481 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [formatter]  executing total steps: 1
2015-07-21 12:23:20,481 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [formatter]  allocating management threads: 1
2015-07-21 12:23:20,482 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [formatter] starting step: (1/1) ...tFieldFormatter/formatter
2015-07-21 12:23:21,126 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [formatter] submitted hadoop job: job_local1066420790_0001
2015-07-21 12:23:21,126 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [formatter] tracking url: http://localhost:8080/
2015-07-21 12:23:21,196 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/classes/test/data/upper.txt
2015-07-21 12:23:21,234 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.1
2015-07-21 12:23:21,235 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-07-21 12:23:21,243 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: DC356BC92F4749F08C05F0E25E755969, ordinal: 0
2015-07-21 12:23:21,267 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/classes/test/data/upper.txt"]
2015-07-21 12:23:21,267 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextLine[['line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/functionplatform/testFieldFormatter/formatter"]
2015-07-21 12:23:21,268 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DC356BC92F4749F08C05F0E25E755969, mem on start (mb), free: 229, total: 245, max: 672
2015-07-21 12:23:21,281 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: DC356BC92F4749F08C05F0E25E755969, mem on close (mb), free: 228, total: 245, max: 672
2015-07-21 12:23:21,334 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/functionplatform/testFieldFormatter/formatter/_temporary
2015-07-21 12:23:21,335 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [formatter]  completed in: 00:00.851
2015-07-21 12:23:21,410 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/test/output//hadoop2-mr1/functionplatform/testFieldFormatter/formatter
2015-07-21 12:23:21,412 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 1, with capacity: 2
2015-07-21 12:23:21,413 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 209, total: 245, max: 672
2015-07-21 12:23:21,413 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 36% of max mem, to better utilize unused memory consider increasing the cache size
2015-07-21 12:23:21,414 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(105)) - flushed keys num times: 3, with capacity: 2
2015-07-21 12:23:21,414 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(106)) - mem on flush (mb), free: 209, total: 245, max: 672
2015-07-21 12:23:21,414 INFO  cache.LRUHashMapCache (LRUHashMapCache.java:removeEldestEntry(111)) - total mem is 36% of max mem, to better utilize unused memory consider increasing the cache size
2015-07-21 12:23:21,443 INFO  util.Util (Util.java:findMainClass(1325)) - using default application jar, may cause class not found exceptions on the cluster
2015-07-21 12:23:21,443 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /Users/castillo/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.1/616db6028856ef10fd9ffb4ebd59ea94589475c4/cascading-hadoop2-mr1-3.0.1.jar
2015-07-21 12:23:21,504 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [apache] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.051
2015-07-21 12:23:21,506 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [apache] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-07-21 12:23:21,506 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [apache] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-07-21 12:23:21,535 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [apache] starting
2015-07-21 12:23:21,535 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [apache]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/classes/test/data/apache.200.txt"]
2015-07-21 12:23:21,535 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [apache]  sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/functionplatform/testInsert/insert"]
2015-07-21 12:23:21,535 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [apache]  parallel execution of steps is enabled: false
2015-07-21 12:23:21,536 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [apache]  executing total steps: 1
2015-07-21 12:23:21,536 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [apache]  allocating management threads: 1
2015-07-21 12:23:21,536 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [apache] starting step: (1/1) ...latform/testInsert/insert
2015-07-21 12:23:21,710 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [apache] submitted hadoop job: job_local1097285757_0002
2015-07-21 12:23:21,710 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [apache] tracking url: http://localhost:8080/
2015-07-21 12:23:21,715 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/classes/test/data/apache.200.txt
2015-07-21 12:23:21,759 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.1
2015-07-21 12:23:21,759 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-07-21 12:23:21,766 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: D13885F488F148F984C10B9DB80F84E1, ordinal: 0
2015-07-21 12:23:21,771 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/classes/test/data/apache.200.txt"]
2015-07-21 12:23:21,772 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(apache)[by:[{1}:'A']]
2015-07-21 12:23:21,772 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D13885F488F148F984C10B9DB80F84E1, mem on start (mb), free: 193, total: 310, max: 672
2015-07-21 12:23:21,785 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: D13885F488F148F984C10B9DB80F84E1, mem on close (mb), free: 193, total: 310, max: 672
2015-07-21 12:23:21,892 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.1
2015-07-21 12:23:21,892 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-07-21 12:23:21,902 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: CCC20F598DC847788CEB1EB4F9D5FC44, ordinal: 1
2015-07-21 12:23:21,904 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(apache)[by:[{1}:'A']]
2015-07-21 12:23:21,904 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/functionplatform/testInsert/insert"]
2015-07-21 12:23:21,904 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CCC20F598DC847788CEB1EB4F9D5FC44, mem on start (mb), free: 178, total: 310, max: 672
2015-07-21 12:23:21,940 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CCC20F598DC847788CEB1EB4F9D5FC44, mem on close (mb), free: 176, total: 310, max: 672
2015-07-21 12:23:21,978 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/functionplatform/testInsert/insert/_temporary
2015-07-21 12:23:21,979 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [apache]  completed in: 00:00.443
2015-07-21 12:23:22,061 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/test/output//hadoop2-mr1/functionplatform/testInsert/insert
2015-07-21 12:23:22,092 INFO  util.Util (Util.java:findMainClass(1325)) - using default application jar, may cause class not found exceptions on the cluster
2015-07-21 12:23:22,093 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /Users/castillo/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.1/616db6028856ef10fd9ffb4ebd59ea94589475c4/cascading-hadoop2-mr1-3.0.1.jar
2015-07-21 12:23:22,142 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [setvalue] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.043
2015-07-21 12:23:22,143 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [setvalue] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2015-07-21 12:23:22,143 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [setvalue] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-07-21 12:23:22,167 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [setvalue] starting
2015-07-21 12:23:22,167 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [setvalue]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/classes/test/data/upper.txt"]
2015-07-21 12:23:22,168 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [setvalue]  sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/functionplatform/testSetValue/setvalue"]
2015-07-21 12:23:22,168 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [setvalue]  parallel execution of steps is enabled: false
2015-07-21 12:23:22,168 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [setvalue]  executing total steps: 1
2015-07-21 12:23:22,168 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [setvalue]  allocating management threads: 1
2015-07-21 12:23:22,168 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [setvalue] starting step: (1/1) ...orm/testSetValue/setvalue
2015-07-21 12:23:22,391 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [setvalue] submitted hadoop job: job_local1264829250_0003
2015-07-21 12:23:22,391 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [setvalue] tracking url: http://localhost:8080/
2015-07-21 12:23:22,394 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/classes/test/data/upper.txt
2015-07-21 12:23:22,404 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.1
2015-07-21 12:23:22,404 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-07-21 12:23:22,410 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F026A61A77914DA798AE00C00EFCAC8C, ordinal: 0
2015-07-21 12:23:22,411 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/classes/test/data/upper.txt"]
2015-07-21 12:23:22,411 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextLine[['line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/functionplatform/testSetValue/setvalue"]
2015-07-21 12:23:22,412 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F026A61A77914DA798AE00C00EFCAC8C, mem on start (mb), free: 233, total: 310, max: 672
2015-07-21 12:23:22,414 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F026A61A77914DA798AE00C00EFCAC8C, mem on close (mb), free: 233, total: 310, max: 672
2015-07-21 12:23:22,450 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/functionplatform/testSetValue/setvalue/_temporary
2015-07-21 12:23:22,451 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [setvalue]  completed in: 00:00.282
2015-07-21 12:23:22,521 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/test/output//hadoop2-mr1/functionplatform/testSetValue/setvalue

Standard error

SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/hadoop/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/Users/castillo/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.5/6edffc576ce104ec769d954618764f39f0f0f10d/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]