Class cascading.flow.AssemblyPlannerPlatformTest

2

tests

0

failures

0

ignored

2.610s

duration

100%

successful

Tests

Test Duration Result
testCompositeAssembly 2.173s passed
testSimpleAssembly 0.437s passed

Standard output

2015-07-21 12:16:45,839 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(195)) - found 1 test platforms from classpath
2015-07-21 12:16:45,859 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(244)) - adding test: cascading.flow.AssemblyPlannerPlatformTest, with platform: hadoop2-mr1
2015-07-21 12:16:45,884 INFO  hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(119)) - not using cluster
2015-07-21 12:16:46,472 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2015-07-21 12:16:46,581 INFO  platform.TestPlatform (TestPlatform.java:getGlobalProperties(73)) - platform property overrides: 
2015-07-21 12:16:46,673 INFO  util.Util (Util.java:findMainClass(1325)) - using default application jar, may cause class not found exceptions on the cluster
2015-07-21 12:16:46,675 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /Users/castillo/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.1/616db6028856ef10fd9ffb4ebd59ea94589475c4/cascading-hadoop2-mr1-3.0.1.jar
2015-07-21 12:16:46,760 INFO  property.AppProps (AppProps.java:getAppID(174)) - using app.id: B286031EA68A4BDEA3BB020480252ADD
2015-07-21 12:16:46,895 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.086
2015-07-21 12:16:46,899 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-07-21 12:16:46,899 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-07-21 12:16:47,049 INFO  util.Version (Version.java:printBanner(81)) - Concurrent, Inc - Cascading 3.0.1
2015-07-21 12:16:47,051 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [] starting
2015-07-21 12:16:47,051 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - []  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/classes/test/data/apache.10.txt"]
2015-07-21 12:16:47,051 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - []  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/assemblyplannerplatform/testCompositeAssembly/composite"]
2015-07-21 12:16:47,052 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - []  parallel execution of steps is enabled: false
2015-07-21 12:16:47,053 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - []  executing total steps: 1
2015-07-21 12:16:47,053 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - []  allocating management threads: 1
2015-07-21 12:16:47,053 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [] starting step: (1/1) ...mpositeAssembly/composite
2015-07-21 12:16:47,625 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [] submitted hadoop job: job_local825049014_0001
2015-07-21 12:16:47,625 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [] tracking url: http://localhost:8080/
2015-07-21 12:16:47,696 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/classes/test/data/apache.10.txt
2015-07-21 12:16:47,796 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.1
2015-07-21 12:16:47,796 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-07-21 12:16:47,804 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F3605FD55A55416BA189A722DCC572E2, ordinal: 0
2015-07-21 12:16:47,842 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/classes/test/data/apache.10.txt"]
2015-07-21 12:16:47,842 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(test)[by:[{1}:'ip']]
2015-07-21 12:16:47,843 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F3605FD55A55416BA189A722DCC572E2, mem on start (mb), free: 127, total: 245, max: 672
2015-07-21 12:16:47,852 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F3605FD55A55416BA189A722DCC572E2, mem on close (mb), free: 126, total: 245, max: 672
2015-07-21 12:16:47,957 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.1
2015-07-21 12:16:47,957 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-07-21 12:16:47,965 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: E21DD3E3CD4648B5B15356DA0D05AB78, ordinal: 1
2015-07-21 12:16:47,968 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(test)[by:[{1}:'ip']]
2015-07-21 12:16:47,968 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/assemblyplannerplatform/testCompositeAssembly/composite"]
2015-07-21 12:16:47,968 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E21DD3E3CD4648B5B15356DA0D05AB78, mem on start (mb), free: 112, total: 245, max: 672
2015-07-21 12:16:47,987 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: E21DD3E3CD4648B5B15356DA0D05AB78, mem on close (mb), free: 110, total: 245, max: 672
2015-07-21 12:16:48,022 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/assemblyplannerplatform/testCompositeAssembly/composite/_temporary
2015-07-21 12:16:48,023 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - []  completed in: 00:00.970
2015-07-21 12:16:48,055 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/test/output//hadoop2-mr1/assemblyplannerplatform/testCompositeAssembly/composite
2015-07-21 12:16:48,080 INFO  util.Util (Util.java:findMainClass(1325)) - using default application jar, may cause class not found exceptions on the cluster
2015-07-21 12:16:48,081 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /Users/castillo/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.1/616db6028856ef10fd9ffb4ebd59ea94589475c4/cascading-hadoop2-mr1-3.0.1.jar
2015-07-21 12:16:48,139 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.049
2015-07-21 12:16:48,140 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-07-21 12:16:48,140 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-07-21 12:16:48,162 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [] starting
2015-07-21 12:16:48,162 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - []  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/classes/test/data/apache.10.txt"]
2015-07-21 12:16:48,163 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - []  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/assemblyplannerplatform/testSimpleAssembly/simple"]
2015-07-21 12:16:48,163 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - []  parallel execution of steps is enabled: false
2015-07-21 12:16:48,163 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - []  executing total steps: 1
2015-07-21 12:16:48,163 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - []  allocating management threads: 1
2015-07-21 12:16:48,164 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [] starting step: (1/1) ...testSimpleAssembly/simple
2015-07-21 12:16:48,337 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [] submitted hadoop job: job_local1214000464_0002
2015-07-21 12:16:48,337 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [] tracking url: http://localhost:8080/
2015-07-21 12:16:48,341 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/classes/test/data/apache.10.txt
2015-07-21 12:16:48,368 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.1
2015-07-21 12:16:48,368 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-07-21 12:16:48,377 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: F8333CACE70B4776834D6827317E5B55, ordinal: 0
2015-07-21 12:16:48,378 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/classes/test/data/apache.10.txt"]
2015-07-21 12:16:48,378 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(test)[by:[{1}:'ip']]
2015-07-21 12:16:48,378 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F8333CACE70B4776834D6827317E5B55, mem on start (mb), free: 83, total: 310, max: 672
2015-07-21 12:16:48,380 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: F8333CACE70B4776834D6827317E5B55, mem on close (mb), free: 83, total: 310, max: 672
2015-07-21 12:16:48,394 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.1
2015-07-21 12:16:48,394 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-07-21 12:16:48,401 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: CA51E3F44B054A929B9079AC13CB63C3, ordinal: 1
2015-07-21 12:16:48,402 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(test)[by:[{1}:'ip']]
2015-07-21 12:16:48,402 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/assemblyplannerplatform/testSimpleAssembly/simple"]
2015-07-21 12:16:48,403 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CA51E3F44B054A929B9079AC13CB63C3, mem on start (mb), free: 80, total: 310, max: 672
2015-07-21 12:16:48,418 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: CA51E3F44B054A929B9079AC13CB63C3, mem on close (mb), free: 78, total: 310, max: 672
2015-07-21 12:16:48,441 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/assemblyplannerplatform/testSimpleAssembly/simple/_temporary
2015-07-21 12:16:48,441 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - []  completed in: 00:00.279
2015-07-21 12:16:48,493 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/test/output//hadoop2-mr1/assemblyplannerplatform/testSimpleAssembly/simple

Standard error

SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/hadoop/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/Users/castillo/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.5/6edffc576ce104ec769d954618764f39f0f0f10d/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]