Class cascading.flow.hadoop.MapReduceFlowPlatformTest

2

tests

0

failures

0

ignored

2m34.97s

duration

100%

successful

Tests

Test Duration Result
testCascade 1m47.36s passed
testFlow 47.605s passed

Standard output

2016-05-18 05:37:49,425 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(197)) - found 1 test platforms from classpath
2016-05-18 05:37:49,443 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(246)) - adding test: cascading.flow.hadoop.MapReduceFlowPlatformTest, with platform: hadoop2-mr1
2016-05-18 05:37:49,477 INFO  hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(136)) - using cluster
2016-05-18 05:37:50,336 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
2016-05-18 05:37:50,979 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2016-05-18 05:37:51,565 WARN  server.AuthenticationFilter (AuthenticationFilter.java:init(166)) - 'signature.secret' configuration not set, using a random value as secret
2016-05-18 05:37:54,821 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-05-18 05:37:54,972 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-05-18 05:37:55,085 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-05-18 05:37:55,196 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-05-18 05:38:07,042 WARN  server.AuthenticationFilter (AuthenticationFilter.java:init(166)) - 'signature.secret' configuration not set, using a random value as secret
2016-05-18 05:38:08,173 WARN  server.AuthenticationFilter (AuthenticationFilter.java:init(166)) - 'signature.secret' configuration not set, using a random value as secret
2016-05-18 05:38:08,173 WARN  server.AuthenticationFilter (AuthenticationFilter.java:init(166)) - 'signature.secret' configuration not set, using a random value as secret
2016-05-18 05:38:12,274 INFO  platform.TestPlatform (TestPlatform.java:getGlobalProperties(75)) - platform property overrides: 
2016-05-18 05:38:12,352 INFO  property.AppProps (AppProps.java:getAppID(177)) - using app.id: 18068D1FF02545158D7855FFCAEA5D1D
2016-05-18 05:38:12,532 INFO  util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.1.0
2016-05-18 05:38:12,535 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [mrflow] starting
2016-05-18 05:38:12,535 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [mrflow]  source: Hfs["NullScheme"]["hdfs://localhost:44143/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/classes/test/data/apache.10.txt"]
2016-05-18 05:38:12,536 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [mrflow]  sink: Hfs["NullScheme"]["hdfs://localhost:44143/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testFlow/flowTest"]
2016-05-18 05:38:12,536 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [mrflow]  parallel execution of steps is enabled: true
2016-05-18 05:38:12,537 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [mrflow]  executing total steps: 1
2016-05-18 05:38:12,537 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [mrflow]  allocating management threads: 1
2016-05-18 05:38:12,538 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [mrflow] starting step: Hfs["NullScheme"]["hdfs://localhost:44143/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testFlow/flowTest"]
2016-05-18 05:38:12,684 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(150)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2016-05-18 05:38:12,690 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(259)) - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
2016-05-18 05:38:13,374 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [mrflow] submitted hadoop job: job_1463549886772_0001
2016-05-18 05:38:13,374 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [mrflow] tracking url: http://ip-10-158-37-203:36595/proxy/application_1463549886772_0001/
2016-05-18 05:38:29,375 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463549886772_0001_01_000002 is : 143
2016-05-18 05:38:29,513 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463549886772_0001_01_000003 is : 143
2016-05-18 05:38:29,694 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463549886772_0001_01_000004 is : 143
2016-05-18 05:38:29,718 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463549886772_0001_01_000005 is : 143
2016-05-18 05:38:35,736 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463549886772_0001_01_000006 is : 143
2016-05-18 05:38:37,045 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path hdfs://localhost:44143/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testFlow/flowTest/_temporary
2016-05-18 05:38:37,046 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [mrflow]  completed in: 00:24.507, using cpu time: 00:04.040
2016-05-18 05:38:37,071 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/test/output//hadoop2-mr1/mapreduceflowplatform/testFlow/flowTest
2016-05-18 05:38:37,127 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 05:38:37,128 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(176)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.1.0/fdadb6ac788ea19f3412b9569a43a7635318b0c5/cascading-hadoop2-mr1-3.1.0.jar
2016-05-18 05:38:37,253 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.058
2016-05-18 05:38:37,255 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-18 05:38:37,256 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 05:38:37,373 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 05:38:37,374 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(176)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.1.0/fdadb6ac788ea19f3412b9569a43a7635318b0c5/cascading-hadoop2-mr1-3.1.0.jar
2016-05-18 05:38:37,412 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.031
2016-05-18 05:38:37,415 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-18 05:38:37,415 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 05:38:37,558 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] starting
2016-05-18 05:38:37,560 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...]  parallel execution of flows is enabled: true
2016-05-18 05:38:37,560 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...]  executing total flows: 5
2016-05-18 05:38:37,561 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...]  allocating management threads: 5
2016-05-18 05:38:37,561 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] starting flow: first-flow
2016-05-18 05:38:37,563 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow] at least one sink is marked for delete
2016-05-18 05:38:37,564 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-05-18 05:38:37,567 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow] starting
2016-05-18 05:38:37,568 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/classes/test/data/apache.10.txt"]
2016-05-18 05:38:37,568 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow4"]
2016-05-18 05:38:37,568 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow]  parallel execution of steps is enabled: true
2016-05-18 05:38:37,568 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow]  executing total steps: 1
2016-05-18 05:38:37,568 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow]  allocating management threads: 1
2016-05-18 05:38:37,569 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow] starting step: (1/1) ...latform/testCascade/flow4
2016-05-18 05:38:37,759 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow] submitted hadoop job: job_1463549886772_0002
2016-05-18 05:38:37,759 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow] tracking url: http://ip-10-158-37-203:36595/proxy/application_1463549886772_0002/
2016-05-18 05:38:53,900 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463549886772_0002_01_000003 is : 143
2016-05-18 05:38:54,003 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463549886772_0002_01_000005 is : 143
2016-05-18 05:38:54,161 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463549886772_0002_01_000002 is : 143
2016-05-18 05:38:54,337 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463549886772_0002_01_000004 is : 143
2016-05-18 05:38:55,584 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow4/_temporary
2016-05-18 05:38:55,588 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow]  completed in: 00:18.014, using cpu time: 00:04.020
2016-05-18 05:38:55,588 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] completed flow: first-flow
2016-05-18 05:38:55,589 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] starting flow: second-flow
2016-05-18 05:38:55,589 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow] at least one sink is marked for delete
2016-05-18 05:38:55,589 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-05-18 05:38:55,595 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow] starting
2016-05-18 05:38:55,595 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow4"]
2016-05-18 05:38:55,595 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow5"]
2016-05-18 05:38:55,596 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow]  parallel execution of steps is enabled: true
2016-05-18 05:38:55,596 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow]  executing total steps: 1
2016-05-18 05:38:55,597 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow]  allocating management threads: 1
2016-05-18 05:38:55,598 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow] starting step: (1/1) ...latform/testCascade/flow5
2016-05-18 05:38:55,759 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow] submitted hadoop job: job_1463549886772_0003
2016-05-18 05:38:55,759 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow] tracking url: http://ip-10-158-37-203:36595/proxy/application_1463549886772_0003/
2016-05-18 05:39:14,279 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463549886772_0003_01_000002 is : 143
2016-05-18 05:39:14,543 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463549886772_0003_01_000004 is : 143
2016-05-18 05:39:14,677 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463549886772_0003_01_000005 is : 143
2016-05-18 05:39:14,735 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463549886772_0003_01_000006 is : 143
2016-05-18 05:39:14,957 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463549886772_0003_01_000003 is : 143
2016-05-18 05:39:16,208 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow5/_temporary
2016-05-18 05:39:16,210 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow]  completed in: 00:20.611, using cpu time: 00:04.960
2016-05-18 05:39:16,210 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] completed flow: second-flow
2016-05-18 05:39:16,214 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] starting flow: first-mr
2016-05-18 05:39:16,214 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr] at least one sink is marked for delete
2016-05-18 05:39:16,214 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-05-18 05:39:16,217 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr] starting
2016-05-18 05:39:16,218 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr]  source: Hfs["NullScheme"]["hdfs://localhost:44143/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow5"]
2016-05-18 05:39:16,218 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr]  sink: Hfs["NullScheme"]["hdfs://localhost:44143/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow1"]
2016-05-18 05:39:16,218 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr]  parallel execution of steps is enabled: true
2016-05-18 05:39:16,219 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr]  executing total steps: 1
2016-05-18 05:39:16,219 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr]  allocating management threads: 1
2016-05-18 05:39:16,220 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr] starting step: Hfs["NullScheme"]["hdfs://localhost:44143/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow1"]
2016-05-18 05:39:16,250 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(150)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2016-05-18 05:39:16,255 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(259)) - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
2016-05-18 05:39:16,350 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr] submitted hadoop job: job_1463549886772_0004
2016-05-18 05:39:16,350 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr] tracking url: http://ip-10-158-37-203:36595/proxy/application_1463549886772_0004/
2016-05-18 05:39:35,274 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463549886772_0004_01_000002 is : 143
2016-05-18 05:39:35,843 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463549886772_0004_01_000003 is : 143
2016-05-18 05:39:36,620 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463549886772_0004_01_000005 is : 143
2016-05-18 05:39:36,699 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463549886772_0004_01_000007 is : 143
2016-05-18 05:39:36,890 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463549886772_0004_01_000004 is : 143
2016-05-18 05:39:41,919 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463549886772_0004_01_000008 is : 143
2016-05-18 05:39:43,175 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path hdfs://localhost:44143/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow1/_temporary
2016-05-18 05:39:43,177 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr]  completed in: 00:26.955, using cpu time: 00:05.480
2016-05-18 05:39:43,178 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] completed flow: first-mr
2016-05-18 05:39:43,178 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] starting flow: second-mr
2016-05-18 05:39:43,178 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr] at least one sink is marked for delete
2016-05-18 05:39:43,178 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-05-18 05:39:43,181 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr] starting
2016-05-18 05:39:43,181 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr]  source: Hfs["NullScheme"]["hdfs://localhost:44143/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow1"]
2016-05-18 05:39:43,181 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr]  sink: Hfs["NullScheme"]["hdfs://localhost:44143/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow2"]
2016-05-18 05:39:43,182 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr]  parallel execution of steps is enabled: true
2016-05-18 05:39:43,182 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr]  executing total steps: 1
2016-05-18 05:39:43,182 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr]  allocating management threads: 1
2016-05-18 05:39:43,183 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr] starting step: Hfs["NullScheme"]["hdfs://localhost:44143/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow2"]
2016-05-18 05:39:43,216 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(150)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2016-05-18 05:39:43,221 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(259)) - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
2016-05-18 05:39:43,359 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr] submitted hadoop job: job_1463549886772_0005
2016-05-18 05:39:43,359 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr] tracking url: http://ip-10-158-37-203:36595/proxy/application_1463549886772_0005/
2016-05-18 05:39:58,356 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463549886772_0005_01_000002 is : 143
2016-05-18 05:39:58,756 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463549886772_0005_01_000003 is : 143
2016-05-18 05:39:59,036 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463549886772_0005_01_000004 is : 143
2016-05-18 05:39:59,067 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463549886772_0005_01_000005 is : 143
2016-05-18 05:40:04,982 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463549886772_0005_01_000006 is : 143
2016-05-18 05:40:06,238 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path hdfs://localhost:44143/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow2/_temporary
2016-05-18 05:40:06,239 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr]  completed in: 00:23.055, using cpu time: 00:03.970
2016-05-18 05:40:06,239 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] completed flow: second-mr
2016-05-18 05:40:06,240 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] starting flow: third-mr
2016-05-18 05:40:06,240 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr] at least one sink is marked for delete
2016-05-18 05:40:06,240 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-05-18 05:40:06,243 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr] starting
2016-05-18 05:40:06,243 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr]  source: Hfs["NullScheme"]["hdfs://localhost:44143/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow2"]
2016-05-18 05:40:06,244 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr]  sink: Hfs["NullScheme"]["hdfs://localhost:44143/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow3"]
2016-05-18 05:40:06,244 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr]  parallel execution of steps is enabled: true
2016-05-18 05:40:06,244 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr]  executing total steps: 1
2016-05-18 05:40:06,244 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr]  allocating management threads: 1
2016-05-18 05:40:06,245 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr] starting step: Hfs["NullScheme"]["hdfs://localhost:44143/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow3"]
2016-05-18 05:40:06,272 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(150)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2016-05-18 05:40:06,277 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(259)) - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
2016-05-18 05:40:06,368 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr] submitted hadoop job: job_1463549886772_0006
2016-05-18 05:40:06,368 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr] tracking url: http://ip-10-158-37-203:36595/proxy/application_1463549886772_0006/
2016-05-18 05:40:16,866 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463549886772_0006_01_000002 is : 143
2016-05-18 05:40:23,122 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463549886772_0006_01_000003 is : 143
2016-05-18 05:40:24,377 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path hdfs://localhost:44143/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow3/_temporary
2016-05-18 05:40:24,379 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr]  completed in: 00:18.132, using cpu time: 00:01.730
2016-05-18 05:40:24,379 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] completed flow: third-mr
2016-05-18 05:40:24,400 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/test/output//hadoop2-mr1/mapreduceflowplatform/testCascade/flow4
2016-05-18 05:40:24,412 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/test/output//hadoop2-mr1/mapreduceflowplatform/testCascade/flow5
2016-05-18 05:40:24,427 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/test/output//hadoop2-mr1/mapreduceflowplatform/testCascade/flow2
2016-05-18 05:40:24,433 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/test/output//hadoop2-mr1/mapreduceflowplatform/testCascade/flow3
2016-05-18 05:40:24,438 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/test/output//hadoop2-mr1/mapreduceflowplatform/testCascade/flow1

Standard error

May 18, 2016 5:38:07 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class
May 18, 2016 5:38:07 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class
May 18, 2016 5:38:07 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 18, 2016 5:38:07 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 18, 2016 5:38:07 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 5:38:07 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 5:38:08 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest"
May 18, 2016 5:38:08 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 18, 2016 5:38:08 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class
May 18, 2016 5:38:08 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class
May 18, 2016 5:38:08 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 18, 2016 5:38:08 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 18, 2016 5:38:08 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 5:38:08 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 5:38:08 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 5:38:08 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 18, 2016 5:38:09 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
May 18, 2016 5:38:09 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 18, 2016 5:38:09 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
May 18, 2016 5:38:09 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 18, 2016 5:38:09 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 5:38:09 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 5:38:09 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 5:38:09 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 18, 2016 5:38:10 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
May 18, 2016 5:38:10 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 18, 2016 5:38:10 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
May 18, 2016 5:38:10 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 18, 2016 5:38:10 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 5:38:10 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 5:38:10 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 5:38:10 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 18, 2016 5:38:11 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
May 18, 2016 5:38:11 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 18, 2016 5:38:11 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
May 18, 2016 5:38:11 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 18, 2016 5:38:11 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 5:38:11 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 5:38:11 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 5:38:11 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.