Class cascading.flow.hadoop.MapReduceFlowPlatformTest

2

tests

0

failures

0

ignored

3m15.27s

duration

100%

successful

Tests

Test Duration Result
testCascade 2m24.48s passed
testFlow 50.789s passed

Standard output

2016-05-18 11:41:52,947 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(197)) - found 1 test platforms from classpath
2016-05-18 11:41:52,959 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(246)) - adding test: cascading.flow.hadoop.MapReduceFlowPlatformTest, with platform: hadoop2-mr1
2016-05-18 11:41:52,980 INFO  hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(136)) - using cluster
2016-05-18 11:41:54,176 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
2016-05-18 11:41:54,826 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(125)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2016-05-18 11:41:59,465 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-05-18 11:41:59,733 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-05-18 11:41:59,908 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-05-18 11:42:00,084 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-05-18 11:42:17,180 INFO  platform.TestPlatform (TestPlatform.java:getGlobalProperties(75)) - platform property overrides: 
2016-05-18 11:42:17,249 INFO  property.AppProps (AppProps.java:getAppID(177)) - using app.id: 5BB87D9DFF36474ABF9988164BC8BCDD
2016-05-18 11:42:17,441 INFO  util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.1.0
2016-05-18 11:42:17,443 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [mrflow] starting
2016-05-18 11:42:17,443 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [mrflow]  source: Hfs["NullScheme"]["hdfs://localhost:53090/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/classes/test/data/apache.10.txt"]
2016-05-18 11:42:17,444 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [mrflow]  sink: Hfs["NullScheme"]["hdfs://localhost:53090/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testFlow/flowTest"]
2016-05-18 11:42:17,444 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [mrflow]  parallel execution of steps is enabled: true
2016-05-18 11:42:17,446 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [mrflow]  executing total steps: 1
2016-05-18 11:42:17,446 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [mrflow]  allocating management threads: 1
2016-05-18 11:42:17,447 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [mrflow] starting step: Hfs["NullScheme"]["hdfs://localhost:53090/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testFlow/flowTest"]
2016-05-18 11:42:17,616 WARN  mapreduce.JobResourceUploader (JobResourceUploader.java:uploadFiles(64)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2016-05-18 11:42:17,620 WARN  mapreduce.JobResourceUploader (JobResourceUploader.java:uploadFiles(171)) - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
2016-05-18 11:42:18,286 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [mrflow] submitted hadoop job: job_1463571731678_0001
2016-05-18 11:42:18,286 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [mrflow] tracking url: http://ip-10-158-37-203:55609/proxy/application_1463571731678_0001/
2016-05-18 11:42:36,317 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463571731678_0001_01_000002 is : 143
2016-05-18 11:42:36,714 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463571731678_0001_01_000003 is : 143
2016-05-18 11:42:37,171 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463571731678_0001_01_000005 is : 143
2016-05-18 11:42:37,359 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463571731678_0001_01_000004 is : 143
2016-05-18 11:42:42,455 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463571731678_0001_01_000006 is : 143
2016-05-18 11:42:43,707 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path hdfs://localhost:53090/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testFlow/flowTest/_temporary
2016-05-18 11:42:43,709 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [mrflow]  completed in: 00:26.261, using cpu time: 00:03.320
2016-05-18 11:42:43,758 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output//hadoop2-mr1/mapreduceflowplatform/testFlow/flowTest
2016-05-18 11:42:43,825 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 11:42:43,826 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(176)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.1.0/fdadb6ac788ea19f3412b9569a43a7635318b0c5/cascading-hadoop2-mr1-3.1.0.jar
2016-05-18 11:42:43,966 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.065
2016-05-18 11:42:43,968 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-18 11:42:43,968 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 11:42:44,065 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 11:42:44,065 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(176)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.1.0/fdadb6ac788ea19f3412b9569a43a7635318b0c5/cascading-hadoop2-mr1-3.1.0.jar
2016-05-18 11:42:44,104 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.032
2016-05-18 11:42:44,105 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-18 11:42:44,106 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 11:42:44,256 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] starting
2016-05-18 11:42:44,259 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...]  parallel execution of flows is enabled: true
2016-05-18 11:42:44,259 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...]  executing total flows: 5
2016-05-18 11:42:44,260 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...]  allocating management threads: 5
2016-05-18 11:42:44,261 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] starting flow: first-flow
2016-05-18 11:42:44,262 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow] at least one sink is marked for delete
2016-05-18 11:42:44,262 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-05-18 11:42:44,267 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow] starting
2016-05-18 11:42:44,267 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/classes/test/data/apache.10.txt"]
2016-05-18 11:42:44,268 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow4"]
2016-05-18 11:42:44,268 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow]  parallel execution of steps is enabled: true
2016-05-18 11:42:44,268 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow]  executing total steps: 1
2016-05-18 11:42:44,268 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow]  allocating management threads: 1
2016-05-18 11:42:44,269 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow] starting step: (1/1) ...latform/testCascade/flow4
2016-05-18 11:42:44,675 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow] submitted hadoop job: job_1463571731678_0002
2016-05-18 11:42:44,675 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow] tracking url: http://ip-10-158-37-203:55609/proxy/application_1463571731678_0002/
2016-05-18 11:43:07,890 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463571731678_0002_01_000003 is : 143
2016-05-18 11:43:07,961 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463571731678_0002_01_000004 is : 143
2016-05-18 11:43:08,017 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463571731678_0002_01_000005 is : 143
2016-05-18 11:43:09,234 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow4/_temporary
2016-05-18 11:43:09,236 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-flow]  completed in: 00:24.965, using cpu time: 00:04.270
2016-05-18 11:43:09,236 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] completed flow: first-flow
2016-05-18 11:43:09,237 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] starting flow: second-flow
2016-05-18 11:43:09,237 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow] at least one sink is marked for delete
2016-05-18 11:43:09,237 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-05-18 11:43:09,243 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow] starting
2016-05-18 11:43:09,243 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow4"]
2016-05-18 11:43:09,243 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow5"]
2016-05-18 11:43:09,243 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow]  parallel execution of steps is enabled: true
2016-05-18 11:43:09,243 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow]  executing total steps: 1
2016-05-18 11:43:09,243 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow]  allocating management threads: 1
2016-05-18 11:43:09,244 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow] starting step: (1/1) ...latform/testCascade/flow5
2016-05-18 11:43:09,434 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow] submitted hadoop job: job_1463571731678_0003
2016-05-18 11:43:09,434 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow] tracking url: http://ip-10-158-37-203:55609/proxy/application_1463571731678_0003/
2016-05-18 11:43:34,805 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463571731678_0003_01_000003 is : 143
2016-05-18 11:43:35,006 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463571731678_0003_01_000002 is : 143
2016-05-18 11:43:35,190 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463571731678_0003_01_000005 is : 143
2016-05-18 11:43:35,863 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463571731678_0003_01_000006 is : 143
2016-05-18 11:43:36,246 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463571731678_0003_01_000004 is : 143
2016-05-18 11:43:37,450 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow5/_temporary
2016-05-18 11:43:37,452 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-flow]  completed in: 00:28.204, using cpu time: 00:05.130
2016-05-18 11:43:37,452 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] completed flow: second-flow
2016-05-18 11:43:37,457 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] starting flow: first-mr
2016-05-18 11:43:37,457 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr] at least one sink is marked for delete
2016-05-18 11:43:37,457 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-05-18 11:43:37,461 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr] starting
2016-05-18 11:43:37,461 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr]  source: Hfs["NullScheme"]["hdfs://localhost:53090/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow5"]
2016-05-18 11:43:37,461 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr]  sink: Hfs["NullScheme"]["hdfs://localhost:53090/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow1"]
2016-05-18 11:43:37,462 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr]  parallel execution of steps is enabled: true
2016-05-18 11:43:37,462 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr]  executing total steps: 1
2016-05-18 11:43:37,462 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr]  allocating management threads: 1
2016-05-18 11:43:37,464 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr] starting step: Hfs["NullScheme"]["hdfs://localhost:53090/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow1"]
2016-05-18 11:43:37,508 WARN  mapreduce.JobResourceUploader (JobResourceUploader.java:uploadFiles(64)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2016-05-18 11:43:37,511 WARN  mapreduce.JobResourceUploader (JobResourceUploader.java:uploadFiles(171)) - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
2016-05-18 11:43:37,603 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr] submitted hadoop job: job_1463571731678_0004
2016-05-18 11:43:37,603 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr] tracking url: http://ip-10-158-37-203:55609/proxy/application_1463571731678_0004/
2016-05-18 11:44:03,949 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463571731678_0004_01_000002 is : 143
2016-05-18 11:44:04,571 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463571731678_0004_01_000003 is : 143
2016-05-18 11:44:04,970 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463571731678_0004_01_000006 is : 143
2016-05-18 11:44:05,266 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463571731678_0004_01_000005 is : 143
2016-05-18 11:44:05,323 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463571731678_0004_01_000007 is : 143
2016-05-18 11:44:05,671 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463571731678_0004_01_000004 is : 143
2016-05-18 11:44:10,819 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463571731678_0004_01_000008 is : 143
2016-05-18 11:44:12,025 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path hdfs://localhost:53090/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow1/_temporary
2016-05-18 11:44:12,027 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [first-mr]  completed in: 00:34.561, using cpu time: 00:05.010
2016-05-18 11:44:12,027 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] completed flow: first-mr
2016-05-18 11:44:12,027 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] starting flow: second-mr
2016-05-18 11:44:12,027 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr] at least one sink is marked for delete
2016-05-18 11:44:12,028 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-05-18 11:44:12,030 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr] starting
2016-05-18 11:44:12,031 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr]  source: Hfs["NullScheme"]["hdfs://localhost:53090/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow1"]
2016-05-18 11:44:12,031 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr]  sink: Hfs["NullScheme"]["hdfs://localhost:53090/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow2"]
2016-05-18 11:44:12,031 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr]  parallel execution of steps is enabled: true
2016-05-18 11:44:12,032 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr]  executing total steps: 1
2016-05-18 11:44:12,032 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr]  allocating management threads: 1
2016-05-18 11:44:12,033 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr] starting step: Hfs["NullScheme"]["hdfs://localhost:53090/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow2"]
2016-05-18 11:44:12,064 WARN  mapreduce.JobResourceUploader (JobResourceUploader.java:uploadFiles(64)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2016-05-18 11:44:12,067 WARN  mapreduce.JobResourceUploader (JobResourceUploader.java:uploadFiles(171)) - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
2016-05-18 11:44:12,189 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr] submitted hadoop job: job_1463571731678_0005
2016-05-18 11:44:12,189 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr] tracking url: http://ip-10-158-37-203:55609/proxy/application_1463571731678_0005/
2016-05-18 11:44:34,629 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463571731678_0005_01_000004 is : 143
2016-05-18 11:44:34,792 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463571731678_0005_01_000002 is : 143
2016-05-18 11:44:34,931 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463571731678_0005_01_000003 is : 143
2016-05-18 11:44:35,009 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463571731678_0005_01_000005 is : 143
2016-05-18 11:44:41,655 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463571731678_0005_01_000006 is : 143
2016-05-18 11:44:42,882 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path hdfs://localhost:53090/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow2/_temporary
2016-05-18 11:44:42,884 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [second-mr]  completed in: 00:30.850, using cpu time: 00:03.460
2016-05-18 11:44:42,884 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] completed flow: second-mr
2016-05-18 11:44:42,884 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] starting flow: third-mr
2016-05-18 11:44:42,885 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr] at least one sink is marked for delete
2016-05-18 11:44:42,885 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-05-18 11:44:42,888 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr] starting
2016-05-18 11:44:42,888 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr]  source: Hfs["NullScheme"]["hdfs://localhost:53090/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow2"]
2016-05-18 11:44:42,888 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr]  sink: Hfs["NullScheme"]["hdfs://localhost:53090/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow3"]
2016-05-18 11:44:42,888 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr]  parallel execution of steps is enabled: true
2016-05-18 11:44:42,889 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr]  executing total steps: 1
2016-05-18 11:44:42,889 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr]  allocating management threads: 1
2016-05-18 11:44:42,891 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr] starting step: Hfs["NullScheme"]["hdfs://localhost:53090/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow3"]
2016-05-18 11:44:42,920 WARN  mapreduce.JobResourceUploader (JobResourceUploader.java:uploadFiles(64)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2016-05-18 11:44:42,922 WARN  mapreduce.JobResourceUploader (JobResourceUploader.java:uploadFiles(171)) - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
2016-05-18 11:44:43,201 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr] submitted hadoop job: job_1463571731678_0006
2016-05-18 11:44:43,202 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr] tracking url: http://ip-10-158-37-203:55609/proxy/application_1463571731678_0006/
2016-05-18 11:45:00,500 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463571731678_0006_01_000002 is : 143
2016-05-18 11:45:07,006 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463571731678_0006_01_000003 is : 143
2016-05-18 11:45:08,183 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path hdfs://localhost:53090/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow3/_temporary
2016-05-18 11:45:08,185 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [third-mr]  completed in: 00:25.293, using cpu time: 00:01.470
2016-05-18 11:45:08,185 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] completed flow: third-mr
2016-05-18 11:45:08,206 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output//hadoop2-mr1/mapreduceflowplatform/testCascade/flow4
2016-05-18 11:45:08,219 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output//hadoop2-mr1/mapreduceflowplatform/testCascade/flow5
2016-05-18 11:45:08,233 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output//hadoop2-mr1/mapreduceflowplatform/testCascade/flow1
2016-05-18 11:45:08,238 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output//hadoop2-mr1/mapreduceflowplatform/testCascade/flow2
2016-05-18 11:45:08,243 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output//hadoop2-mr1/mapreduceflowplatform/testCascade/flow3

Standard error

May 18, 2016 11:42:10 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class
May 18, 2016 11:42:10 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class
May 18, 2016 11:42:10 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 18, 2016 11:42:10 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 18, 2016 11:42:10 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 11:42:10 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 11:42:11 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest"
May 18, 2016 11:42:11 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 18, 2016 11:42:11 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class
May 18, 2016 11:42:11 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class
May 18, 2016 11:42:11 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 18, 2016 11:42:11 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 18, 2016 11:42:11 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 11:42:12 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 11:42:12 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 11:42:13 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 18, 2016 11:42:13 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
May 18, 2016 11:42:13 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 18, 2016 11:42:13 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
May 18, 2016 11:42:13 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 18, 2016 11:42:13 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 11:42:13 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 11:42:13 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 11:42:14 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 18, 2016 11:42:14 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
May 18, 2016 11:42:14 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 18, 2016 11:42:14 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
May 18, 2016 11:42:14 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 18, 2016 11:42:14 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 11:42:14 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 11:42:14 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 11:42:15 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 18, 2016 11:42:15 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
May 18, 2016 11:42:15 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 18, 2016 11:42:15 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
May 18, 2016 11:42:15 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 18, 2016 11:42:15 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 11:42:15 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 11:42:15 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 11:42:16 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 18, 2016 11:42:16 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
May 18, 2016 11:42:16 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 18, 2016 11:42:16 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
May 18, 2016 11:42:16 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 18, 2016 11:42:16 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 11:42:16 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 11:42:16 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"