Class cascading.flow.hadoop.MapReduceFlowPlatformTest

2

tests

0

failures

0

ignored

3m6.02s

duration

100%

successful

Tests

Test Duration Result
testCascade 2m16.33s passed
testFlow 49.687s passed

Standard output

2016-05-18 08:33:38,327 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(197)) - found 1 test platforms from classpath
2016-05-18 08:33:38,340 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(246)) - adding test: cascading.flow.hadoop.MapReduceFlowPlatformTest, with platform: hadoop2-mr1
2016-05-18 08:33:38,367 INFO  hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(136)) - using cluster
2016-05-18 08:33:39,305 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
2016-05-18 08:33:40,009 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2016-05-18 08:33:44,269 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-05-18 08:33:44,498 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-05-18 08:33:44,669 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-05-18 08:33:44,842 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-05-18 08:34:01,980 INFO  platform.TestPlatform (TestPlatform.java:getGlobalProperties(75)) - platform property overrides: 
2016-05-18 08:34:02,051 INFO  property.AppProps (AppProps.java:getAppID(177)) - using app.id: DAED7F00BFB540C9A7426CB172848BE2
2016-05-18 08:34:02,285 INFO  util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.1.0
2016-05-18 08:34:02,287 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [mrflow] starting
2016-05-18 08:34:02,288 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [mrflow]  source: Hfs["NullScheme"]["hdfs://localhost:46834/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.6.x/build/classes/test/data/apache.10.txt"]
2016-05-18 08:34:02,288 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [mrflow]  sink: Hfs["NullScheme"]["hdfs://localhost:46834/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.6.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testFlow/flowTest"]
2016-05-18 08:34:02,289 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [mrflow]  parallel execution of steps is enabled: true
2016-05-18 08:34:02,290 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [mrflow]  executing total steps: 1
2016-05-18 08:34:02,290 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [mrflow]  allocating management threads: 1
2016-05-18 08:34:02,291 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [mrflow] starting step: Hfs["NullScheme"]["hdfs://localhost:46834/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.6.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testFlow/flowTest"]
2016-05-18 08:34:02,473 WARN  mapreduce.JobResourceUploader (JobResourceUploader.java:uploadFiles(64)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2016-05-18 08:34:02,477 WARN  mapreduce.JobResourceUploader (JobResourceUploader.java:uploadFiles(171)) - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
2016-05-18 08:34:02,948 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [mrflow] submitted hadoop job: job_1463560436479_0001
2016-05-18 08:34:02,949 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [mrflow] tracking url: http://ip-10-158-37-203:49480/proxy/application_1463560436479_0001/
2016-05-18 08:34:20,120 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463560436479_0001_01_000003 is : 143
2016-05-18 08:34:20,198 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463560436479_0001_01_000004 is : 143
2016-05-18 08:34:26,757 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463560436479_0001_01_000006 is : 143
2016-05-18 08:34:28,013 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path hdfs://localhost:46834/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.6.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testFlow/flowTest/_temporary
2016-05-18 08:34:28,015 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [mrflow]  completed in: 00:25.723, using cpu time: 00:03.600
2016-05-18 08:34:28,040 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.6.x/build/test/output//hadoop2-mr1/mapreduceflowplatform/testFlow/flowTest
2016-05-18 08:34:28,147 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 08:34:28,148 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(176)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.1.0/fdadb6ac788ea19f3412b9569a43a7635318b0c5/cascading-hadoop2-mr1-3.1.0.jar
2016-05-18 08:34:28,268 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.051
2016-05-18 08:34:28,271 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-18 08:34:28,271 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 08:34:28,351 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 08:34:28,351 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(176)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.1.0/fdadb6ac788ea19f3412b9569a43a7635318b0c5/cascading-hadoop2-mr1-3.1.0.jar
2016-05-18 08:34:28,389 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.031
2016-05-18 08:34:28,391 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-18 08:34:28,391 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 08:34:28,536 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] starting
2016-05-18 08:34:28,538 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...]  parallel execution of flows is enabled: true
2016-05-18 08:34:28,538 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...]  executing total flows: 5
2016-05-18 08:34:28,538 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...]  allocating management threads: 5
2016-05-18 08:34:28,539 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] starting flow: first-flow
2016-05-18 08:34:28,541 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow] at least one sink is marked for delete
2016-05-18 08:34:28,541 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-05-18 08:34:28,545 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow] starting
2016-05-18 08:34:28,546 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.6.x/build/classes/test/data/apache.10.txt"]
2016-05-18 08:34:28,546 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.6.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow4"]
2016-05-18 08:34:28,546 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow]  parallel execution of steps is enabled: true
2016-05-18 08:34:28,546 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow]  executing total steps: 1
2016-05-18 08:34:28,547 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow]  allocating management threads: 1
2016-05-18 08:34:28,547 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow] starting step: (1/1) ...latform/testCascade/flow4
2016-05-18 08:34:28,718 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow] submitted hadoop job: job_1463560436479_0002
2016-05-18 08:34:28,718 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow] tracking url: http://ip-10-158-37-203:49480/proxy/application_1463560436479_0002/
2016-05-18 08:34:49,932 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463560436479_0002_01_000002 is : 143
2016-05-18 08:34:50,034 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463560436479_0002_01_000003 is : 143
2016-05-18 08:34:50,127 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463560436479_0002_01_000005 is : 143
2016-05-18 08:34:50,265 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463560436479_0002_01_000004 is : 143
2016-05-18 08:34:51,475 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.6.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow4/_temporary
2016-05-18 08:34:51,477 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow]  completed in: 00:22.928, using cpu time: 00:04.480
2016-05-18 08:34:51,478 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] completed flow: first-flow
2016-05-18 08:34:51,478 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] starting flow: second-flow
2016-05-18 08:34:51,478 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow] at least one sink is marked for delete
2016-05-18 08:34:51,478 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-05-18 08:34:51,483 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow] starting
2016-05-18 08:34:51,483 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.6.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow4"]
2016-05-18 08:34:51,484 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.6.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow5"]
2016-05-18 08:34:51,484 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow]  parallel execution of steps is enabled: true
2016-05-18 08:34:51,484 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow]  executing total steps: 1
2016-05-18 08:34:51,484 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow]  allocating management threads: 1
2016-05-18 08:34:51,485 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow] starting step: (1/1) ...latform/testCascade/flow5
2016-05-18 08:34:51,630 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow] submitted hadoop job: job_1463560436479_0003
2016-05-18 08:34:51,631 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow] tracking url: http://ip-10-158-37-203:49480/proxy/application_1463560436479_0003/
2016-05-18 08:35:14,957 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463560436479_0003_01_000003 is : 143
2016-05-18 08:35:15,680 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463560436479_0003_01_000002 is : 143
2016-05-18 08:35:15,973 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463560436479_0003_01_000006 is : 143
2016-05-18 08:35:16,167 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463560436479_0003_01_000004 is : 143
2016-05-18 08:35:16,250 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463560436479_0003_01_000005 is : 143
2016-05-18 08:35:17,462 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.6.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow5/_temporary
2016-05-18 08:35:17,466 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow]  completed in: 00:25.973, using cpu time: 00:05.320
2016-05-18 08:35:17,466 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] completed flow: second-flow
2016-05-18 08:35:17,466 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] starting flow: first-mr
2016-05-18 08:35:17,467 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr] at least one sink is marked for delete
2016-05-18 08:35:17,467 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-05-18 08:35:17,479 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr] starting
2016-05-18 08:35:17,480 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr]  source: Hfs["NullScheme"]["hdfs://localhost:46834/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.6.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow5"]
2016-05-18 08:35:17,480 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr]  sink: Hfs["NullScheme"]["hdfs://localhost:46834/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.6.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow1"]
2016-05-18 08:35:17,480 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr]  parallel execution of steps is enabled: true
2016-05-18 08:35:17,481 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr]  executing total steps: 1
2016-05-18 08:35:17,481 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr]  allocating management threads: 1
2016-05-18 08:35:17,483 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr] starting step: Hfs["NullScheme"]["hdfs://localhost:46834/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.6.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow1"]
2016-05-18 08:35:17,515 WARN  mapreduce.JobResourceUploader (JobResourceUploader.java:uploadFiles(64)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2016-05-18 08:35:17,517 WARN  mapreduce.JobResourceUploader (JobResourceUploader.java:uploadFiles(171)) - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
2016-05-18 08:35:17,604 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr] submitted hadoop job: job_1463560436479_0004
2016-05-18 08:35:17,604 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr] tracking url: http://ip-10-158-37-203:49480/proxy/application_1463560436479_0004/
2016-05-18 08:35:42,407 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463560436479_0004_01_000003 is : 143
2016-05-18 08:35:42,576 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463560436479_0004_01_000002 is : 143
2016-05-18 08:35:42,995 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463560436479_0004_01_000004 is : 143
2016-05-18 08:35:43,261 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463560436479_0004_01_000006 is : 143
2016-05-18 08:35:43,479 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463560436479_0004_01_000005 is : 143
2016-05-18 08:35:43,519 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463560436479_0004_01_000007 is : 143
2016-05-18 08:35:48,865 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463560436479_0004_01_000008 is : 143
2016-05-18 08:35:50,070 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path hdfs://localhost:46834/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.6.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow1/_temporary
2016-05-18 08:35:50,073 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr]  completed in: 00:32.584, using cpu time: 00:04.960
2016-05-18 08:35:50,073 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] completed flow: first-mr
2016-05-18 08:35:50,073 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] starting flow: second-mr
2016-05-18 08:35:50,073 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr] at least one sink is marked for delete
2016-05-18 08:35:50,073 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-05-18 08:35:50,077 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr] starting
2016-05-18 08:35:50,077 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr]  source: Hfs["NullScheme"]["hdfs://localhost:46834/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.6.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow1"]
2016-05-18 08:35:50,077 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr]  sink: Hfs["NullScheme"]["hdfs://localhost:46834/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.6.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow2"]
2016-05-18 08:35:50,077 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr]  parallel execution of steps is enabled: true
2016-05-18 08:35:50,078 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr]  executing total steps: 1
2016-05-18 08:35:50,078 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr]  allocating management threads: 1
2016-05-18 08:35:50,079 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr] starting step: Hfs["NullScheme"]["hdfs://localhost:46834/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.6.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow2"]
2016-05-18 08:35:50,108 WARN  mapreduce.JobResourceUploader (JobResourceUploader.java:uploadFiles(64)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2016-05-18 08:35:50,110 WARN  mapreduce.JobResourceUploader (JobResourceUploader.java:uploadFiles(171)) - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
2016-05-18 08:35:50,230 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr] submitted hadoop job: job_1463560436479_0005
2016-05-18 08:35:50,230 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr] tracking url: http://ip-10-158-37-203:49480/proxy/application_1463560436479_0005/
2016-05-18 08:36:11,535 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463560436479_0005_01_000004 is : 143
2016-05-18 08:36:11,622 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463560436479_0005_01_000003 is : 143
2016-05-18 08:36:11,711 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463560436479_0005_01_000002 is : 143
2016-05-18 08:36:11,738 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463560436479_0005_01_000005 is : 143
2016-05-18 08:36:19,358 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463560436479_0005_01_000006 is : 143
2016-05-18 08:36:20,532 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path hdfs://localhost:46834/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.6.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow2/_temporary
2016-05-18 08:36:20,533 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr]  completed in: 00:30.452, using cpu time: 00:03.840
2016-05-18 08:36:20,533 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] completed flow: second-mr
2016-05-18 08:36:20,533 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] starting flow: third-mr
2016-05-18 08:36:20,534 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr] at least one sink is marked for delete
2016-05-18 08:36:20,534 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-05-18 08:36:20,537 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr] starting
2016-05-18 08:36:20,537 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr]  source: Hfs["NullScheme"]["hdfs://localhost:46834/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.6.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow2"]
2016-05-18 08:36:20,537 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr]  sink: Hfs["NullScheme"]["hdfs://localhost:46834/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.6.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow3"]
2016-05-18 08:36:20,538 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr]  parallel execution of steps is enabled: true
2016-05-18 08:36:20,538 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr]  executing total steps: 1
2016-05-18 08:36:20,538 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr]  allocating management threads: 1
2016-05-18 08:36:20,539 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr] starting step: Hfs["NullScheme"]["hdfs://localhost:46834/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.6.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow3"]
2016-05-18 08:36:20,568 WARN  mapreduce.JobResourceUploader (JobResourceUploader.java:uploadFiles(64)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2016-05-18 08:36:20,570 WARN  mapreduce.JobResourceUploader (JobResourceUploader.java:uploadFiles(171)) - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
2016-05-18 08:36:20,643 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr] submitted hadoop job: job_1463560436479_0006
2016-05-18 08:36:20,644 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr] tracking url: http://ip-10-158-37-203:49480/proxy/application_1463560436479_0006/
2016-05-18 08:36:36,555 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463560436479_0006_01_000002 is : 143
2016-05-18 08:36:43,122 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463560436479_0006_01_000003 is : 143
2016-05-18 08:36:44,317 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path hdfs://localhost:46834/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.6.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow3/_temporary
2016-05-18 08:36:44,318 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr]  completed in: 00:23.777, using cpu time: 00:01.570
2016-05-18 08:36:44,318 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] completed flow: third-mr
2016-05-18 08:36:44,339 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.6.x/build/test/output//hadoop2-mr1/mapreduceflowplatform/testCascade/flow5
2016-05-18 08:36:44,352 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.6.x/build/test/output//hadoop2-mr1/mapreduceflowplatform/testCascade/flow4
2016-05-18 08:36:44,366 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.6.x/build/test/output//hadoop2-mr1/mapreduceflowplatform/testCascade/flow3
2016-05-18 08:36:44,371 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.6.x/build/test/output//hadoop2-mr1/mapreduceflowplatform/testCascade/flow2
2016-05-18 08:36:44,376 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.6.x/build/test/output//hadoop2-mr1/mapreduceflowplatform/testCascade/flow1

Standard error

Exception in thread "org.apache.hadoop.util.JvmPauseMonitor$Monitor@6c9b0123" java.lang.NoSuchMethodError: com.google.common.base.Stopwatch.elapsedMillis()J
	at org.apache.hadoop.util.JvmPauseMonitor$Monitor.run(JvmPauseMonitor.java:186)
	at java.lang.Thread.run(Thread.java:745)
Exception in thread "org.apache.hadoop.util.JvmPauseMonitor$Monitor@54369a8e" java.lang.NoSuchMethodError: com.google.common.base.Stopwatch.elapsedMillis()J
	at org.apache.hadoop.util.JvmPauseMonitor$Monitor.run(JvmPauseMonitor.java:186)
	at java.lang.Thread.run(Thread.java:745)
Exception in thread "org.apache.hadoop.util.JvmPauseMonitor$Monitor@555ac023" java.lang.NoSuchMethodError: com.google.common.base.Stopwatch.elapsedMillis()J
	at org.apache.hadoop.util.JvmPauseMonitor$Monitor.run(JvmPauseMonitor.java:186)
	at java.lang.Thread.run(Thread.java:745)
Exception in thread "org.apache.hadoop.util.JvmPauseMonitor$Monitor@1b25be07" java.lang.NoSuchMethodError: com.google.common.base.Stopwatch.elapsedMillis()J
	at org.apache.hadoop.util.JvmPauseMonitor$Monitor.run(JvmPauseMonitor.java:186)
	at java.lang.Thread.run(Thread.java:745)
Exception in thread "org.apache.hadoop.util.JvmPauseMonitor$Monitor@5843066b" java.lang.NoSuchMethodError: com.google.common.base.Stopwatch.elapsedMillis()J
	at org.apache.hadoop.util.JvmPauseMonitor$Monitor.run(JvmPauseMonitor.java:186)
	at java.lang.Thread.run(Thread.java:745)
May 18, 2016 8:33:56 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class
May 18, 2016 8:33:56 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class
May 18, 2016 8:33:56 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 18, 2016 8:33:56 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 18, 2016 8:33:56 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 8:33:57 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 8:33:57 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest"
May 18, 2016 8:33:57 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 18, 2016 8:33:58 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class
May 18, 2016 8:33:58 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class
May 18, 2016 8:33:58 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 18, 2016 8:33:58 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 18, 2016 8:33:58 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 8:33:58 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 8:33:58 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 8:33:58 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 18, 2016 8:33:59 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
May 18, 2016 8:33:59 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 18, 2016 8:33:59 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
May 18, 2016 8:33:59 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 18, 2016 8:33:59 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 8:33:59 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 8:33:59 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 8:33:59 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 18, 2016 8:34:00 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
May 18, 2016 8:34:00 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 18, 2016 8:34:00 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
May 18, 2016 8:34:00 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 18, 2016 8:34:00 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 8:34:00 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 8:34:00 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 8:34:00 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 18, 2016 8:34:01 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
May 18, 2016 8:34:01 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 18, 2016 8:34:01 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
May 18, 2016 8:34:01 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 18, 2016 8:34:01 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 8:34:01 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 8:34:01 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 8:34:01 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.