Class cascading.flow.hadoop.MapReduceFlowPlatformTest

2

tests

0

failures

0

ignored

2m35.28s

duration

100%

successful

Tests

Test Duration Result
testCascade 1m47.92s passed
testFlow 47.365s passed

Standard output

2016-05-18 03:11:26,305 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(197)) - found 1 test platforms from classpath
2016-05-18 03:11:26,321 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(246)) - adding test: cascading.flow.hadoop.MapReduceFlowPlatformTest, with platform: hadoop2-mr1
2016-05-18 03:11:26,355 INFO  hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(136)) - using cluster
2016-05-18 03:11:27,180 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
2016-05-18 03:11:27,789 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2016-05-18 03:11:28,344 WARN  server.AuthenticationFilter (AuthenticationFilter.java:init(162)) - 'signature.secret' configuration not set, using a random value as secret
2016-05-18 03:11:31,458 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-05-18 03:11:31,605 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-05-18 03:11:31,715 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-05-18 03:11:31,827 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-05-18 03:11:48,901 INFO  platform.TestPlatform (TestPlatform.java:getGlobalProperties(75)) - platform property overrides: 
2016-05-18 03:11:48,972 INFO  property.AppProps (AppProps.java:getAppID(177)) - using app.id: 98D4C2F10EFB4852958D8FB9571A7B29
2016-05-18 03:11:49,161 INFO  util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.1.0
2016-05-18 03:11:49,164 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [mrflow] starting
2016-05-18 03:11:49,164 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [mrflow]  source: Hfs["NullScheme"]["hdfs://localhost:36592/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.4.x/build/classes/test/data/apache.10.txt"]
2016-05-18 03:11:49,165 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [mrflow]  sink: Hfs["NullScheme"]["hdfs://localhost:36592/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.4.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testFlow/flowTest"]
2016-05-18 03:11:49,166 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [mrflow]  parallel execution of steps is enabled: true
2016-05-18 03:11:49,166 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [mrflow]  executing total steps: 1
2016-05-18 03:11:49,166 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [mrflow]  allocating management threads: 1
2016-05-18 03:11:49,167 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [mrflow] starting step: Hfs["NullScheme"]["hdfs://localhost:36592/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.4.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testFlow/flowTest"]
2016-05-18 03:11:49,321 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(150)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2016-05-18 03:11:49,327 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(259)) - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
2016-05-18 03:11:49,972 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [mrflow] submitted hadoop job: job_1463541103399_0001
2016-05-18 03:11:49,973 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [mrflow] tracking url: http://ip-10-158-37-203:43794/proxy/application_1463541103399_0001/
2016-05-18 03:12:06,232 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463541103399_0001_01_000003 is : 143
2016-05-18 03:12:06,464 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463541103399_0001_01_000002 is : 143
2016-05-18 03:12:06,556 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463541103399_0001_01_000004 is : 143
2016-05-18 03:12:12,362 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463541103399_0001_01_000006 is : 143
2016-05-18 03:12:13,683 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path hdfs://localhost:36592/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.4.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testFlow/flowTest/_temporary
2016-05-18 03:12:13,685 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [mrflow]  completed in: 00:24.517, using cpu time: 00:04.050
2016-05-18 03:12:13,708 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.4.x/build/test/output//hadoop2-mr1/mapreduceflowplatform/testFlow/flowTest
2016-05-18 03:12:13,768 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 03:12:13,769 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(176)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.1.0/fdadb6ac788ea19f3412b9569a43a7635318b0c5/cascading-hadoop2-mr1-3.1.0.jar
2016-05-18 03:12:13,894 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.053
2016-05-18 03:12:13,897 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-18 03:12:13,897 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 03:12:13,981 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 03:12:13,982 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(176)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.1.0/fdadb6ac788ea19f3412b9569a43a7635318b0c5/cascading-hadoop2-mr1-3.1.0.jar
2016-05-18 03:12:14,019 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.032
2016-05-18 03:12:14,021 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-18 03:12:14,021 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 03:12:14,193 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] starting
2016-05-18 03:12:14,198 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...]  parallel execution of flows is enabled: true
2016-05-18 03:12:14,198 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...]  executing total flows: 5
2016-05-18 03:12:14,198 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...]  allocating management threads: 5
2016-05-18 03:12:14,199 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] starting flow: first-flow
2016-05-18 03:12:14,199 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow] at least one sink is marked for delete
2016-05-18 03:12:14,199 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-05-18 03:12:14,203 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow] starting
2016-05-18 03:12:14,203 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.4.x/build/classes/test/data/apache.10.txt"]
2016-05-18 03:12:14,204 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.4.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow4"]
2016-05-18 03:12:14,204 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow]  parallel execution of steps is enabled: true
2016-05-18 03:12:14,204 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow]  executing total steps: 1
2016-05-18 03:12:14,204 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow]  allocating management threads: 1
2016-05-18 03:12:14,206 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow] starting step: (1/1) ...latform/testCascade/flow4
2016-05-18 03:12:14,453 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow] submitted hadoop job: job_1463541103399_0002
2016-05-18 03:12:14,453 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow] tracking url: http://ip-10-158-37-203:43794/proxy/application_1463541103399_0002/
2016-05-18 03:12:30,915 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463541103399_0002_01_000002 is : 143
2016-05-18 03:12:31,032 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463541103399_0002_01_000004 is : 143
2016-05-18 03:12:31,980 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463541103399_0002_01_000005 is : 143
2016-05-18 03:12:32,011 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463541103399_0002_01_000003 is : 143
2016-05-18 03:12:33,249 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.4.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow4/_temporary
2016-05-18 03:12:33,251 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow]  completed in: 00:19.043, using cpu time: 00:06.420
2016-05-18 03:12:33,251 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] completed flow: first-flow
2016-05-18 03:12:33,252 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] starting flow: second-flow
2016-05-18 03:12:33,252 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow] at least one sink is marked for delete
2016-05-18 03:12:33,252 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-05-18 03:12:33,259 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow] starting
2016-05-18 03:12:33,259 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.4.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow4"]
2016-05-18 03:12:33,259 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.4.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow5"]
2016-05-18 03:12:33,260 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow]  parallel execution of steps is enabled: true
2016-05-18 03:12:33,260 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow]  executing total steps: 1
2016-05-18 03:12:33,260 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow]  allocating management threads: 1
2016-05-18 03:12:33,261 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow] starting step: (1/1) ...latform/testCascade/flow5
2016-05-18 03:12:33,426 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow] submitted hadoop job: job_1463541103399_0003
2016-05-18 03:12:33,426 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow] tracking url: http://ip-10-158-37-203:43794/proxy/application_1463541103399_0003/
2016-05-18 03:12:51,643 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463541103399_0003_01_000005 is : 143
2016-05-18 03:12:51,908 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463541103399_0003_01_000003 is : 143
2016-05-18 03:12:52,059 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463541103399_0003_01_000002 is : 143
2016-05-18 03:12:52,139 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463541103399_0003_01_000004 is : 143
2016-05-18 03:12:53,425 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.4.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow5/_temporary
2016-05-18 03:12:53,426 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow]  completed in: 00:20.164, using cpu time: 00:06.570
2016-05-18 03:12:53,426 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] completed flow: second-flow
2016-05-18 03:12:53,427 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] starting flow: first-mr
2016-05-18 03:12:53,427 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr] at least one sink is marked for delete
2016-05-18 03:12:53,427 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-05-18 03:12:53,433 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr] starting
2016-05-18 03:12:53,433 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr]  source: Hfs["NullScheme"]["hdfs://localhost:36592/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.4.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow5"]
2016-05-18 03:12:53,434 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr]  sink: Hfs["NullScheme"]["hdfs://localhost:36592/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.4.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow1"]
2016-05-18 03:12:53,434 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr]  parallel execution of steps is enabled: true
2016-05-18 03:12:53,434 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr]  executing total steps: 1
2016-05-18 03:12:53,434 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr]  allocating management threads: 1
2016-05-18 03:12:53,436 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr] starting step: Hfs["NullScheme"]["hdfs://localhost:36592/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.4.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow1"]
2016-05-18 03:12:53,465 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(150)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2016-05-18 03:12:53,470 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(259)) - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
2016-05-18 03:12:53,571 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr] submitted hadoop job: job_1463541103399_0004
2016-05-18 03:12:53,571 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr] tracking url: http://ip-10-158-37-203:43794/proxy/application_1463541103399_0004/
2016-05-18 03:13:12,925 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463541103399_0004_01_000003 is : 143
2016-05-18 03:13:13,302 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463541103399_0004_01_000002 is : 143
2016-05-18 03:13:13,555 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463541103399_0004_01_000007 is : 143
2016-05-18 03:13:13,786 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463541103399_0004_01_000004 is : 143
2016-05-18 03:13:13,879 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463541103399_0004_01_000005 is : 143
2016-05-18 03:13:13,927 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463541103399_0004_01_000006 is : 143
2016-05-18 03:13:19,380 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463541103399_0004_01_000008 is : 143
2016-05-18 03:13:20,661 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path hdfs://localhost:36592/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.4.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow1/_temporary
2016-05-18 03:13:20,663 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr]  completed in: 00:27.226, using cpu time: 00:05.620
2016-05-18 03:13:20,663 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] completed flow: first-mr
2016-05-18 03:13:20,663 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] starting flow: second-mr
2016-05-18 03:13:20,663 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr] at least one sink is marked for delete
2016-05-18 03:13:20,664 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-05-18 03:13:20,667 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr] starting
2016-05-18 03:13:20,667 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr]  source: Hfs["NullScheme"]["hdfs://localhost:36592/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.4.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow1"]
2016-05-18 03:13:20,668 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr]  sink: Hfs["NullScheme"]["hdfs://localhost:36592/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.4.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow2"]
2016-05-18 03:13:20,668 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr]  parallel execution of steps is enabled: true
2016-05-18 03:13:20,668 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr]  executing total steps: 1
2016-05-18 03:13:20,668 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr]  allocating management threads: 1
2016-05-18 03:13:20,669 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr] starting step: Hfs["NullScheme"]["hdfs://localhost:36592/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.4.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow2"]
2016-05-18 03:13:20,698 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(150)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2016-05-18 03:13:20,705 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(259)) - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
2016-05-18 03:13:20,806 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr] submitted hadoop job: job_1463541103399_0005
2016-05-18 03:13:20,806 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr] tracking url: http://ip-10-158-37-203:43794/proxy/application_1463541103399_0005/
2016-05-18 03:13:35,916 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463541103399_0005_01_000003 is : 143
2016-05-18 03:13:36,162 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463541103399_0005_01_000005 is : 143
2016-05-18 03:13:36,251 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463541103399_0005_01_000002 is : 143
2016-05-18 03:13:36,395 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463541103399_0005_01_000004 is : 143
2016-05-18 03:13:42,378 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463541103399_0005_01_000006 is : 143
2016-05-18 03:13:43,601 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path hdfs://localhost:36592/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.4.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow2/_temporary
2016-05-18 03:13:43,603 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr]  completed in: 00:22.929, using cpu time: 00:04.000
2016-05-18 03:13:43,603 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] completed flow: second-mr
2016-05-18 03:13:43,603 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] starting flow: third-mr
2016-05-18 03:13:43,604 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr] at least one sink is marked for delete
2016-05-18 03:13:43,604 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-05-18 03:13:43,606 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr] starting
2016-05-18 03:13:43,607 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr]  source: Hfs["NullScheme"]["hdfs://localhost:36592/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.4.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow2"]
2016-05-18 03:13:43,607 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr]  sink: Hfs["NullScheme"]["hdfs://localhost:36592/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.4.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow3"]
2016-05-18 03:13:43,607 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr]  parallel execution of steps is enabled: true
2016-05-18 03:13:43,608 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr]  executing total steps: 1
2016-05-18 03:13:43,608 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr]  allocating management threads: 1
2016-05-18 03:13:43,608 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr] starting step: Hfs["NullScheme"]["hdfs://localhost:36592/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.4.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow3"]
2016-05-18 03:13:43,634 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(150)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2016-05-18 03:13:43,639 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(259)) - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
2016-05-18 03:13:43,727 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr] submitted hadoop job: job_1463541103399_0006
2016-05-18 03:13:43,727 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr] tracking url: http://ip-10-158-37-203:43794/proxy/application_1463541103399_0006/
2016-05-18 03:13:53,857 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463541103399_0006_01_000002 is : 143
2016-05-18 03:14:00,319 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463541103399_0006_01_000003 is : 143
2016-05-18 03:14:01,558 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path hdfs://localhost:36592/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.4.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow3/_temporary
2016-05-18 03:14:01,560 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr]  completed in: 00:17.949, using cpu time: 00:01.670
2016-05-18 03:14:01,560 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] completed flow: third-mr
2016-05-18 03:14:01,582 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.4.x/build/test/output//hadoop2-mr1/mapreduceflowplatform/testCascade/flow5
2016-05-18 03:14:01,596 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.4.x/build/test/output//hadoop2-mr1/mapreduceflowplatform/testCascade/flow1
2016-05-18 03:14:01,603 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.4.x/build/test/output//hadoop2-mr1/mapreduceflowplatform/testCascade/flow2
2016-05-18 03:14:01,610 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.4.x/build/test/output//hadoop2-mr1/mapreduceflowplatform/testCascade/flow3
2016-05-18 03:14:01,616 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.4.x/build/test/output//hadoop2-mr1/mapreduceflowplatform/testCascade/flow4

Standard error

May 18, 2016 3:11:43 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class
May 18, 2016 3:11:43 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class
May 18, 2016 3:11:43 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 18, 2016 3:11:43 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 18, 2016 3:11:43 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 3:11:44 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 3:11:44 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest"
May 18, 2016 3:11:44 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 18, 2016 3:11:45 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class
May 18, 2016 3:11:45 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class
May 18, 2016 3:11:45 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 18, 2016 3:11:45 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 18, 2016 3:11:45 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 3:11:45 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 3:11:45 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 3:11:45 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 18, 2016 3:11:46 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
May 18, 2016 3:11:46 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 18, 2016 3:11:46 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
May 18, 2016 3:11:46 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 18, 2016 3:11:46 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 3:11:46 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 3:11:46 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 3:11:46 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 18, 2016 3:11:47 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
May 18, 2016 3:11:47 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 18, 2016 3:11:47 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
May 18, 2016 3:11:47 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 18, 2016 3:11:47 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 3:11:47 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 3:11:47 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 3:11:47 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 18, 2016 3:11:48 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
May 18, 2016 3:11:48 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 18, 2016 3:11:48 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
May 18, 2016 3:11:48 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 18, 2016 3:11:48 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 3:11:48 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 3:11:48 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 3:11:48 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.