Class cascading.flow.hadoop.MapReduceFlowPlatformTest

2

tests

0

failures

0

ignored

2m42.93s

duration

100%

successful

Tests

Test Duration Result
testCascade 1m52.61s passed
testFlow 50.320s passed

Standard output

2016-01-15 02:10:28,688 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(195)) - found 1 test platforms from classpath
2016-01-15 02:10:28,701 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(244)) - adding test: cascading.flow.hadoop.MapReduceFlowPlatformTest, with platform: hadoop2-mr1
2016-01-15 02:10:28,724 INFO  hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(136)) - using cluster
2016-01-15 02:10:29,761 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
2016-01-15 02:10:30,438 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2016-01-15 02:10:34,828 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-15 02:10:35,037 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-15 02:10:35,205 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-15 02:10:35,379 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-15 02:10:52,479 INFO  platform.TestPlatform (TestPlatform.java:getGlobalProperties(73)) - platform property overrides: 
2016-01-15 02:10:52,552 INFO  property.AppProps (AppProps.java:getAppID(177)) - using app.id: 36F9A33853BB4731AADF39072654A3C6
2016-01-15 02:10:52,742 INFO  util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.0.4
2016-01-15 02:10:52,745 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mrflow] starting
2016-01-15 02:10:52,745 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mrflow]  source: Hfs["NullScheme"]["hdfs://localhost:43357/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.6.x/build/classes/test/data/apache.10.txt"]
2016-01-15 02:10:52,745 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mrflow]  sink: Hfs["NullScheme"]["hdfs://localhost:43357/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.6.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testFlow/flowTest"]
2016-01-15 02:10:52,746 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mrflow]  parallel execution of steps is enabled: true
2016-01-15 02:10:52,747 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mrflow]  executing total steps: 1
2016-01-15 02:10:52,747 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mrflow]  allocating management threads: 1
2016-01-15 02:10:52,748 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mrflow] starting step: Hfs["NullScheme"]["hdfs://localhost:43357/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.6.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testFlow/flowTest"]
2016-01-15 02:10:52,978 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(153)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2016-01-15 02:10:52,983 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(261)) - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
2016-01-15 02:10:53,705 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mrflow] submitted hadoop job: job_1452823846977_0001
2016-01-15 02:10:53,706 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mrflow] tracking url: http://ip-10-167-78-165:48432/proxy/application_1452823846977_0001/
2016-01-15 02:11:10,786 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452823846977_0001_01_000003 is : 143
2016-01-15 02:11:10,922 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452823846977_0001_01_000002 is : 143
2016-01-15 02:11:11,154 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452823846977_0001_01_000005 is : 143
2016-01-15 02:11:17,740 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452823846977_0001_01_000006 is : 143
2016-01-15 02:11:19,008 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path hdfs://localhost:43357/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.6.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testFlow/flowTest/_temporary
2016-01-15 02:11:19,010 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mrflow]  completed in: 00:26.262, using cpu time: 00:03.770
2016-01-15 02:11:19,034 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.6.x/build/test/output//hadoop2-mr1/mapreduceflowplatform/testFlow/flowTest
2016-01-15 02:11:19,092 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 02:11:19,093 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 02:11:19,215 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.053
2016-01-15 02:11:19,217 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 02:11:19,217 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 02:11:19,294 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 02:11:19,294 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 02:11:19,333 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.032
2016-01-15 02:11:19,334 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 02:11:19,334 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 02:11:19,492 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] starting
2016-01-15 02:11:19,495 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...]  parallel execution of flows is enabled: true
2016-01-15 02:11:19,495 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...]  executing total flows: 5
2016-01-15 02:11:19,496 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...]  allocating management threads: 5
2016-01-15 02:11:19,497 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] starting flow: first-flow
2016-01-15 02:11:19,497 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow] at least one sink is marked for delete
2016-01-15 02:11:19,498 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-01-15 02:11:19,503 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow] starting
2016-01-15 02:11:19,503 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.6.x/build/classes/test/data/apache.10.txt"]
2016-01-15 02:11:19,503 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.6.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow4"]
2016-01-15 02:11:19,503 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow]  parallel execution of steps is enabled: true
2016-01-15 02:11:19,503 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow]  executing total steps: 1
2016-01-15 02:11:19,504 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow]  allocating management threads: 1
2016-01-15 02:11:19,504 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow] starting step: (1/1) ...latform/testCascade/flow4
2016-01-15 02:11:19,709 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow] submitted hadoop job: job_1452823846977_0002
2016-01-15 02:11:19,709 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow] tracking url: http://ip-10-167-78-165:48432/proxy/application_1452823846977_0002/
2016-01-15 02:11:36,146 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452823846977_0002_01_000003 is : 143
2016-01-15 02:11:36,788 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452823846977_0002_01_000005 is : 143
2016-01-15 02:11:36,836 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452823846977_0002_01_000004 is : 143
2016-01-15 02:11:38,043 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.6.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow4/_temporary
2016-01-15 02:11:38,045 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow]  completed in: 00:18.537, using cpu time: 00:04.370
2016-01-15 02:11:38,045 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] completed flow: first-flow
2016-01-15 02:11:38,045 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] starting flow: second-flow
2016-01-15 02:11:38,045 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow] at least one sink is marked for delete
2016-01-15 02:11:38,045 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-01-15 02:11:38,051 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow] starting
2016-01-15 02:11:38,051 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.6.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow4"]
2016-01-15 02:11:38,052 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.6.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow5"]
2016-01-15 02:11:38,052 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow]  parallel execution of steps is enabled: true
2016-01-15 02:11:38,052 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow]  executing total steps: 1
2016-01-15 02:11:38,052 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow]  allocating management threads: 1
2016-01-15 02:11:38,053 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow] starting step: (1/1) ...latform/testCascade/flow5
2016-01-15 02:11:38,212 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow] submitted hadoop job: job_1452823846977_0003
2016-01-15 02:11:38,212 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow] tracking url: http://ip-10-167-78-165:48432/proxy/application_1452823846977_0003/
2016-01-15 02:11:57,650 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452823846977_0003_01_000002 is : 143
2016-01-15 02:11:57,781 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452823846977_0003_01_000006 is : 143
2016-01-15 02:11:57,781 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452823846977_0003_01_000004 is : 143
2016-01-15 02:11:57,954 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452823846977_0003_01_000005 is : 143
2016-01-15 02:11:58,344 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452823846977_0003_01_000003 is : 143
2016-01-15 02:11:59,551 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.6.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow5/_temporary
2016-01-15 02:11:59,553 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow]  completed in: 00:21.494, using cpu time: 00:05.290
2016-01-15 02:11:59,553 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] completed flow: second-flow
2016-01-15 02:11:59,553 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] starting flow: first-mr
2016-01-15 02:11:59,553 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-mr] at least one sink is marked for delete
2016-01-15 02:11:59,558 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-mr] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-01-15 02:11:59,562 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-mr] starting
2016-01-15 02:11:59,562 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-mr]  source: Hfs["NullScheme"]["hdfs://localhost:43357/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.6.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow5"]
2016-01-15 02:11:59,562 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-mr]  sink: Hfs["NullScheme"]["hdfs://localhost:43357/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.6.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow1"]
2016-01-15 02:11:59,562 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-mr]  parallel execution of steps is enabled: true
2016-01-15 02:11:59,562 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-mr]  executing total steps: 1
2016-01-15 02:11:59,562 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-mr]  allocating management threads: 1
2016-01-15 02:11:59,563 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-mr] starting step: Hfs["NullScheme"]["hdfs://localhost:43357/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.6.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow1"]
2016-01-15 02:11:59,592 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(153)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2016-01-15 02:11:59,595 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(261)) - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
2016-01-15 02:11:59,678 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-mr] submitted hadoop job: job_1452823846977_0004
2016-01-15 02:11:59,678 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-mr] tracking url: http://ip-10-167-78-165:48432/proxy/application_1452823846977_0004/
2016-01-15 02:12:20,037 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452823846977_0004_01_000003 is : 143
2016-01-15 02:12:20,198 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452823846977_0004_01_000002 is : 143
2016-01-15 02:12:20,577 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452823846977_0004_01_000005 is : 143
2016-01-15 02:12:20,860 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452823846977_0004_01_000007 is : 143
2016-01-15 02:12:20,931 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452823846977_0004_01_000004 is : 143
2016-01-15 02:12:26,575 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452823846977_0004_01_000008 is : 143
2016-01-15 02:12:27,774 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path hdfs://localhost:43357/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.6.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow1/_temporary
2016-01-15 02:12:27,776 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-mr]  completed in: 00:28.205, using cpu time: 00:05.280
2016-01-15 02:12:27,776 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] completed flow: first-mr
2016-01-15 02:12:27,777 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] starting flow: second-mr
2016-01-15 02:12:27,777 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-mr] at least one sink is marked for delete
2016-01-15 02:12:27,777 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-mr] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-01-15 02:12:27,782 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-mr] starting
2016-01-15 02:12:27,782 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-mr]  source: Hfs["NullScheme"]["hdfs://localhost:43357/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.6.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow1"]
2016-01-15 02:12:27,783 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-mr]  sink: Hfs["NullScheme"]["hdfs://localhost:43357/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.6.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow2"]
2016-01-15 02:12:27,783 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-mr]  parallel execution of steps is enabled: true
2016-01-15 02:12:27,784 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-mr]  executing total steps: 1
2016-01-15 02:12:27,784 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-mr]  allocating management threads: 1
2016-01-15 02:12:27,786 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-mr] starting step: Hfs["NullScheme"]["hdfs://localhost:43357/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.6.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow2"]
2016-01-15 02:12:27,821 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(153)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2016-01-15 02:12:27,823 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(261)) - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
2016-01-15 02:12:27,944 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-mr] submitted hadoop job: job_1452823846977_0005
2016-01-15 02:12:27,944 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-mr] tracking url: http://ip-10-167-78-165:48432/proxy/application_1452823846977_0005/
2016-01-15 02:12:44,833 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452823846977_0005_01_000003 is : 143
2016-01-15 02:12:44,860 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452823846977_0005_01_000002 is : 143
2016-01-15 02:12:44,941 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452823846977_0005_01_000004 is : 143
2016-01-15 02:12:45,019 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452823846977_0005_01_000005 is : 143
2016-01-15 02:12:51,793 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452823846977_0005_01_000006 is : 143
2016-01-15 02:12:52,964 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path hdfs://localhost:43357/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.6.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow2/_temporary
2016-01-15 02:12:52,966 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-mr]  completed in: 00:25.180, using cpu time: 00:03.900
2016-01-15 02:12:52,966 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] completed flow: second-mr
2016-01-15 02:12:52,966 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] starting flow: third-mr
2016-01-15 02:12:52,967 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third-mr] at least one sink is marked for delete
2016-01-15 02:12:52,967 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third-mr] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-01-15 02:12:52,969 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third-mr] starting
2016-01-15 02:12:52,970 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third-mr]  source: Hfs["NullScheme"]["hdfs://localhost:43357/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.6.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow2"]
2016-01-15 02:12:52,970 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third-mr]  sink: Hfs["NullScheme"]["hdfs://localhost:43357/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.6.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow3"]
2016-01-15 02:12:52,970 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third-mr]  parallel execution of steps is enabled: true
2016-01-15 02:12:52,971 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third-mr]  executing total steps: 1
2016-01-15 02:12:52,972 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third-mr]  allocating management threads: 1
2016-01-15 02:12:52,972 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third-mr] starting step: Hfs["NullScheme"]["hdfs://localhost:43357/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.6.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow3"]
2016-01-15 02:12:53,001 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(153)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2016-01-15 02:12:53,003 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(261)) - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
2016-01-15 02:12:53,088 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third-mr] submitted hadoop job: job_1452823846977_0006
2016-01-15 02:12:53,089 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third-mr] tracking url: http://ip-10-167-78-165:48432/proxy/application_1452823846977_0006/
2016-01-15 02:13:04,015 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452823846977_0006_01_000002 is : 143
2016-01-15 02:13:10,417 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452823846977_0006_01_000003 is : 143
2016-01-15 02:13:11,582 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path hdfs://localhost:43357/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.6.x/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow3/_temporary
2016-01-15 02:13:11,583 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third-mr]  completed in: 00:18.610, using cpu time: 00:01.560
2016-01-15 02:13:11,583 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] completed flow: third-mr
2016-01-15 02:13:11,604 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.6.x/build/test/output//hadoop2-mr1/mapreduceflowplatform/testCascade/flow4
2016-01-15 02:13:11,617 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.6.x/build/test/output//hadoop2-mr1/mapreduceflowplatform/testCascade/flow5
2016-01-15 02:13:11,631 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.6.x/build/test/output//hadoop2-mr1/mapreduceflowplatform/testCascade/flow2
2016-01-15 02:13:11,636 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.6.x/build/test/output//hadoop2-mr1/mapreduceflowplatform/testCascade/flow3
2016-01-15 02:13:11,641 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.6.x/build/test/output//hadoop2-mr1/mapreduceflowplatform/testCascade/flow1

Standard error

Exception in thread "org.apache.hadoop.util.JvmPauseMonitor$Monitor@2f3409c5" java.lang.NoSuchMethodError: com.google.common.base.Stopwatch.elapsedMillis()J
	at org.apache.hadoop.util.JvmPauseMonitor$Monitor.run(JvmPauseMonitor.java:184)
	at java.lang.Thread.run(Thread.java:745)
Exception in thread "org.apache.hadoop.util.JvmPauseMonitor$Monitor@6f4d108d" java.lang.NoSuchMethodError: com.google.common.base.Stopwatch.elapsedMillis()J
	at org.apache.hadoop.util.JvmPauseMonitor$Monitor.run(JvmPauseMonitor.java:184)
	at java.lang.Thread.run(Thread.java:745)
Exception in thread "org.apache.hadoop.util.JvmPauseMonitor$Monitor@53501237" java.lang.NoSuchMethodError: com.google.common.base.Stopwatch.elapsedMillis()J
	at org.apache.hadoop.util.JvmPauseMonitor$Monitor.run(JvmPauseMonitor.java:184)
	at java.lang.Thread.run(Thread.java:745)
Exception in thread "org.apache.hadoop.util.JvmPauseMonitor$Monitor@3a35f31f" java.lang.NoSuchMethodError: com.google.common.base.Stopwatch.elapsedMillis()J
	at org.apache.hadoop.util.JvmPauseMonitor$Monitor.run(JvmPauseMonitor.java:184)
	at java.lang.Thread.run(Thread.java:745)
Exception in thread "org.apache.hadoop.util.JvmPauseMonitor$Monitor@32606c21" java.lang.NoSuchMethodError: com.google.common.base.Stopwatch.elapsedMillis()J
	at org.apache.hadoop.util.JvmPauseMonitor$Monitor.run(JvmPauseMonitor.java:184)
	at java.lang.Thread.run(Thread.java:745)
Jan 15, 2016 2:10:47 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class
Jan 15, 2016 2:10:47 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class
Jan 15, 2016 2:10:47 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Jan 15, 2016 2:10:47 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Jan 15, 2016 2:10:47 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Jan 15, 2016 2:10:47 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Jan 15, 2016 2:10:48 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest"
Jan 15, 2016 2:10:48 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Jan 15, 2016 2:10:48 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class
Jan 15, 2016 2:10:48 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class
Jan 15, 2016 2:10:48 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Jan 15, 2016 2:10:48 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Jan 15, 2016 2:10:48 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Jan 15, 2016 2:10:48 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Jan 15, 2016 2:10:49 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Jan 15, 2016 2:10:49 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Jan 15, 2016 2:10:49 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
Jan 15, 2016 2:10:49 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Jan 15, 2016 2:10:49 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
Jan 15, 2016 2:10:49 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Jan 15, 2016 2:10:49 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Jan 15, 2016 2:10:49 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Jan 15, 2016 2:10:49 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Jan 15, 2016 2:10:49 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Jan 15, 2016 2:10:50 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
Jan 15, 2016 2:10:50 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Jan 15, 2016 2:10:50 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
Jan 15, 2016 2:10:50 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Jan 15, 2016 2:10:50 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Jan 15, 2016 2:10:50 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Jan 15, 2016 2:10:50 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Jan 15, 2016 2:10:50 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Jan 15, 2016 2:10:51 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
Jan 15, 2016 2:10:51 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Jan 15, 2016 2:10:51 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
Jan 15, 2016 2:10:51 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Jan 15, 2016 2:10:51 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Jan 15, 2016 2:10:51 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Jan 15, 2016 2:10:51 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Jan 15, 2016 2:10:51 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.