Class cascading.flow.AssemblyPlannerPlatformTest

2

tests

0

failures

0

ignored

2.924s

duration

100%

successful

Tests

Test Duration Result
testCompositeAssembly 2.417s passed
testSimpleAssembly 0.507s passed

Standard output

2016-01-14 19:03:00,033 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(195)) - found 1 test platforms from classpath
2016-01-14 19:03:00,055 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(244)) - adding test: cascading.flow.AssemblyPlannerPlatformTest, with platform: hadoop2-mr1
2016-01-14 19:03:00,077 INFO  hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(119)) - not using cluster
2016-01-14 19:03:00,574 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2016-01-14 19:03:00,722 INFO  platform.TestPlatform (TestPlatform.java:getGlobalProperties(73)) - platform property overrides: 
2016-01-14 19:03:00,811 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 19:03:00,812 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 19:03:00,891 INFO  property.AppProps (AppProps.java:getAppID(177)) - using app.id: 3CA1798FF8F5486CB204191BAA752F4D
2016-01-14 19:03:01,056 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.111
2016-01-14 19:03:01,059 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 19:03:01,060 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 19:03:01,214 INFO  util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.0.4
2016-01-14 19:03:01,215 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [] starting
2016-01-14 19:03:01,216 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - []  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/classes/test/data/apache.10.txt"]
2016-01-14 19:03:01,216 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - []  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/assemblyplannerplatform/testCompositeAssembly/composite"]
2016-01-14 19:03:01,217 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - []  parallel execution of steps is enabled: false
2016-01-14 19:03:01,218 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - []  executing total steps: 1
2016-01-14 19:03:01,218 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - []  allocating management threads: 1
2016-01-14 19:03:01,219 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [] starting step: (1/1) ...mpositeAssembly/composite
2016-01-14 19:03:01,723 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/tmp/cascading/staging/teamcity42254639/.staging/job_local42254639_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 19:03:01,724 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/tmp/cascading/staging/teamcity42254639/.staging/job_local42254639_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 19:03:01,950 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local42254639_0001/job_local42254639_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 19:03:01,951 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local42254639_0001/job_local42254639_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 19:03:01,965 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [] submitted hadoop job: job_local42254639_0001
2016-01-14 19:03:01,965 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [] tracking url: http://localhost:8080/
2016-01-14 19:03:02,070 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/classes/test/data/apache.10.txt
2016-01-14 19:03:02,203 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 19:03:02,203 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 19:03:02,217 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: A537DA70605F4438A485ADDCEE8007E8, ordinal: 0
2016-01-14 19:03:02,266 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/classes/test/data/apache.10.txt"]
2016-01-14 19:03:02,266 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(test)[by:[{1}:'ip']]
2016-01-14 19:03:02,267 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A537DA70605F4438A485ADDCEE8007E8, mem on start (mb), free: 88, total: 223, max: 672
2016-01-14 19:03:02,277 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: A537DA70605F4438A485ADDCEE8007E8, mem on close (mb), free: 88, total: 223, max: 672
2016-01-14 19:03:02,391 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 19:03:02,392 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 19:03:02,402 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: BF7897D4D1CC4A25AC07B79D00B80FE4, ordinal: 1
2016-01-14 19:03:02,405 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(test)[by:[{1}:'ip']]
2016-01-14 19:03:02,406 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/assemblyplannerplatform/testCompositeAssembly/composite"]
2016-01-14 19:03:02,406 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: BF7897D4D1CC4A25AC07B79D00B80FE4, mem on start (mb), free: 78, total: 223, max: 672
2016-01-14 19:03:02,424 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: BF7897D4D1CC4A25AC07B79D00B80FE4, mem on close (mb), free: 77, total: 223, max: 672
2016-01-14 19:03:02,461 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/assemblyplannerplatform/testCompositeAssembly/composite/_temporary
2016-01-14 19:03:02,462 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - []  completed in: 00:01.245
2016-01-14 19:03:02,492 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/assemblyplannerplatform/testCompositeAssembly/composite
2016-01-14 19:03:02,514 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 19:03:02,515 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 19:03:02,584 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.059
2016-01-14 19:03:02,585 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2016-01-14 19:03:02,586 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 19:03:02,608 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [] starting
2016-01-14 19:03:02,608 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - []  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/classes/test/data/apache.10.txt"]
2016-01-14 19:03:02,609 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - []  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/assemblyplannerplatform/testSimpleAssembly/simple"]
2016-01-14 19:03:02,609 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - []  parallel execution of steps is enabled: false
2016-01-14 19:03:02,609 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - []  executing total steps: 1
2016-01-14 19:03:02,609 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - []  allocating management threads: 1
2016-01-14 19:03:02,610 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [] starting step: (1/1) ...testSimpleAssembly/simple
2016-01-14 19:03:02,702 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/tmp/cascading/staging/teamcity624254000/.staging/job_local624254000_0002/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 19:03:02,707 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/tmp/cascading/staging/teamcity624254000/.staging/job_local624254000_0002/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 19:03:02,764 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local624254000_0002/job_local624254000_0002.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-01-14 19:03:02,765 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local624254000_0002/job_local624254000_0002.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-01-14 19:03:02,767 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [] submitted hadoop job: job_local624254000_0002
2016-01-14 19:03:02,767 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [] tracking url: http://localhost:8080/
2016-01-14 19:03:02,773 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/classes/test/data/apache.10.txt
2016-01-14 19:03:02,881 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.4
2016-01-14 19:03:02,882 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2016-01-14 19:03:02,892 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: CDA1D323C68549928BD5A554AB156B2A, ordinal: 0
2016-01-14 19:03:02,893 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/classes/test/data/apache.10.txt"]
2016-01-14 19:03:02,894 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(test)[by:[{1}:'ip']]
2016-01-14 19:03:02,894 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: CDA1D323C68549928BD5A554AB156B2A, mem on start (mb), free: 96, total: 323, max: 672
2016-01-14 19:03:02,897 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: CDA1D323C68549928BD5A554AB156B2A, mem on close (mb), free: 96, total: 323, max: 672
2016-01-14 19:03:02,916 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.4
2016-01-14 19:03:02,916 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2016-01-14 19:03:02,928 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: D5A57A2D07A44F8EA41B786577F9C5D3, ordinal: 1
2016-01-14 19:03:02,929 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(test)[by:[{1}:'ip']]
2016-01-14 19:03:02,929 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/assemblyplannerplatform/testSimpleAssembly/simple"]
2016-01-14 19:03:02,930 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D5A57A2D07A44F8EA41B786577F9C5D3, mem on start (mb), free: 93, total: 323, max: 672
2016-01-14 19:03:02,940 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: D5A57A2D07A44F8EA41B786577F9C5D3, mem on close (mb), free: 93, total: 323, max: 672
2016-01-14 19:03:02,967 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/assemblyplannerplatform/testSimpleAssembly/simple/_temporary
2016-01-14 19:03:02,967 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - []  completed in: 00:00.359
2016-01-14 19:03:03,001 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/assemblyplannerplatform/testSimpleAssembly/simple