Class cascading.flow.hadoop.MapReduceFlowPlatformTest

2

tests

0

failures

0

ignored

2m17.49s

duration

100%

successful

Tests

Test Duration Result
testCascade 1m33.54s passed
testFlow 43.945s passed

Standard output

2015-05-20 17:46:55,436 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(187)) - found 1 test platforms from classpath
2015-05-20 17:46:55,465 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(237)) - installing platform: hadoop2-mr1
2015-05-20 17:46:55,465 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(238)) - running test: cascading.flow.hadoop.MapReduceFlowPlatformTest
2015-05-20 17:46:55,480 INFO  hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(121)) - using cluster
2015-05-20 17:46:56,206 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
2015-05-20 17:46:56,786 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2015-05-20 17:47:00,138 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-05-20 17:47:00,337 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-05-20 17:47:00,516 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-05-20 17:47:00,687 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-05-20 17:47:17,849 INFO  property.AppProps (AppProps.java:getAppID(169)) - using app.id: 52FDF4425CCB410B9D1282BAAC0B4373
2015-05-20 17:47:17,965 INFO  util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 2.7.0
2015-05-20 17:47:17,967 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [mrflow] starting
2015-05-20 17:47:17,967 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [mrflow]  source: Hfs["NullScheme"]["hdfs://localhost:51361/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt"]
2015-05-20 17:47:17,968 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [mrflow]  sink: Hfs["NullScheme"]["hdfs://localhost:51361/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/mapreduceflowplatform/flowTest"]
2015-05-20 17:47:17,968 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [mrflow]  parallel execution is enabled: true
2015-05-20 17:47:17,969 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [mrflow]  starting jobs: 1
2015-05-20 17:47:17,969 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [mrflow]  allocating threads: 1
2015-05-20 17:47:17,970 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [mrflow] starting step: Hfs["NullScheme"]["hdfs://localhost:51361/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/mapreduceflowplatform/flowTest"]
2015-05-20 17:47:18,098 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(153)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2015-05-20 17:47:18,102 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(261)) - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
2015-05-20 17:47:18,636 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [mrflow] submitted hadoop job: job_1432169232273_0001
2015-05-20 17:47:18,636 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [mrflow] tracking url: http://Edinburgh.local:51474/proxy/application_1432169232273_0001/
2015-05-20 17:47:33,110 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1432169232273_0001_01_000002 is : 143
2015-05-20 17:47:33,138 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1432169232273_0001_01_000004 is : 143
2015-05-20 17:47:33,164 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1432169232273_0001_01_000003 is : 143
2015-05-20 17:47:33,193 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1432169232273_0001_01_000005 is : 143
2015-05-20 17:47:38,143 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1432169232273_0001_01_000006 is : 143
2015-05-20 17:47:39,393 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path hdfs://localhost:51361/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/mapreduceflowplatform/flowTest/_temporary
2015-05-20 17:47:39,417 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output//hadoop2-mr1/mapreduceflowplatform/flowTest
2015-05-20 17:47:39,474 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 17:47:39,475 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 17:47:39,557 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 17:47:39,557 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 17:47:39,734 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first-flow+second-flow...] starting
2015-05-20 17:47:39,737 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first-flow+second-flow...]  parallel execution is enabled: true
2015-05-20 17:47:39,737 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first-flow+second-flow...]  starting flows: 5
2015-05-20 17:47:39,737 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first-flow+second-flow...]  allocating threads: 5
2015-05-20 17:47:39,738 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first-flow+second-flow...] starting flow: first-flow
2015-05-20 17:47:39,739 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first-flow] at least one sink is marked for delete
2015-05-20 17:47:39,739 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first-flow] sink oldest modified date: Wed Dec 31 15:59:59 PST 1969
2015-05-20 17:47:39,743 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first-flow] starting
2015-05-20 17:47:39,743 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first-flow]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt"]
2015-05-20 17:47:39,744 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first-flow]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/mapreduceflowplatform/flow4"]
2015-05-20 17:47:39,744 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first-flow]  parallel execution is enabled: true
2015-05-20 17:47:39,744 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first-flow]  starting jobs: 1
2015-05-20 17:47:39,744 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first-flow]  allocating threads: 1
2015-05-20 17:47:39,745 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [first-flow] starting step: (1/1) ...preduceflowplatform/flow4
2015-05-20 17:47:39,905 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [first-flow] submitted hadoop job: job_1432169232273_0002
2015-05-20 17:47:39,906 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [first-flow] tracking url: http://Edinburgh.local:51474/proxy/application_1432169232273_0002/
2015-05-20 17:47:54,040 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1432169232273_0002_01_000002 is : 143
2015-05-20 17:47:54,080 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1432169232273_0002_01_000003 is : 143
2015-05-20 17:47:54,310 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1432169232273_0002_01_000005 is : 143
2015-05-20 17:47:54,379 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1432169232273_0002_01_000004 is : 143
2015-05-20 17:47:55,561 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/mapreduceflowplatform/flow4/_temporary
2015-05-20 17:47:55,566 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first-flow+second-flow...] completed flow: first-flow
2015-05-20 17:47:55,567 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first-flow+second-flow...] starting flow: second-flow
2015-05-20 17:47:55,568 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second-flow] at least one sink is marked for delete
2015-05-20 17:47:55,568 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second-flow] sink oldest modified date: Wed Dec 31 15:59:59 PST 1969
2015-05-20 17:47:55,572 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second-flow] starting
2015-05-20 17:47:55,572 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second-flow]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/mapreduceflowplatform/flow4"]
2015-05-20 17:47:55,573 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second-flow]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/mapreduceflowplatform/flow5"]
2015-05-20 17:47:55,573 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second-flow]  parallel execution is enabled: true
2015-05-20 17:47:55,573 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second-flow]  starting jobs: 1
2015-05-20 17:47:55,573 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second-flow]  allocating threads: 1
2015-05-20 17:47:55,574 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [second-flow] starting step: (1/1) ...preduceflowplatform/flow5
2015-05-20 17:47:55,730 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [second-flow] submitted hadoop job: job_1432169232273_0003
2015-05-20 17:47:55,730 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [second-flow] tracking url: http://Edinburgh.local:51474/proxy/application_1432169232273_0003/
2015-05-20 17:48:11,557 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1432169232273_0003_01_000003 is : 143
2015-05-20 17:48:11,809 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1432169232273_0003_01_000002 is : 143
2015-05-20 17:48:11,901 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1432169232273_0003_01_000005 is : 143
2015-05-20 17:48:11,930 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1432169232273_0003_01_000006 is : 143
2015-05-20 17:48:11,977 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1432169232273_0003_01_000004 is : 143
2015-05-20 17:48:13,192 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/mapreduceflowplatform/flow5/_temporary
2015-05-20 17:48:13,193 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first-flow+second-flow...] completed flow: second-flow
2015-05-20 17:48:13,193 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first-flow+second-flow...] starting flow: first-mr
2015-05-20 17:48:13,194 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first-mr] at least one sink is marked for delete
2015-05-20 17:48:13,194 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first-mr] sink oldest modified date: Wed Dec 31 15:59:59 PST 1969
2015-05-20 17:48:13,197 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first-mr] starting
2015-05-20 17:48:13,197 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first-mr]  source: Hfs["NullScheme"]["hdfs://localhost:51361/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/mapreduceflowplatform/flow5"]
2015-05-20 17:48:13,198 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first-mr]  sink: Hfs["NullScheme"]["hdfs://localhost:51361/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/mapreduceflowplatform/flow1"]
2015-05-20 17:48:13,198 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first-mr]  parallel execution is enabled: true
2015-05-20 17:48:13,198 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first-mr]  starting jobs: 1
2015-05-20 17:48:13,198 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first-mr]  allocating threads: 1
2015-05-20 17:48:13,199 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [first-mr] starting step: Hfs["NullScheme"]["hdfs://localhost:51361/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/mapreduceflowplatform/flow1"]
2015-05-20 17:48:13,228 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(153)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2015-05-20 17:48:13,231 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(261)) - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
2015-05-20 17:48:13,313 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [first-mr] submitted hadoop job: job_1432169232273_0004
2015-05-20 17:48:13,314 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [first-mr] tracking url: http://Edinburgh.local:51474/proxy/application_1432169232273_0004/
2015-05-20 17:48:30,339 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1432169232273_0004_01_000003 is : 143
2015-05-20 17:48:30,439 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1432169232273_0004_01_000002 is : 143
2015-05-20 17:48:30,481 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1432169232273_0004_01_000005 is : 143
2015-05-20 17:48:30,556 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1432169232273_0004_01_000006 is : 143
2015-05-20 17:48:30,586 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1432169232273_0004_01_000004 is : 143
2015-05-20 17:48:30,624 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1432169232273_0004_01_000007 is : 143
2015-05-20 17:48:36,038 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1432169232273_0004_01_000008 is : 143
2015-05-20 17:48:37,221 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path hdfs://localhost:51361/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/mapreduceflowplatform/flow1/_temporary
2015-05-20 17:48:37,223 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first-flow+second-flow...] completed flow: first-mr
2015-05-20 17:48:37,223 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first-flow+second-flow...] starting flow: second-mr
2015-05-20 17:48:37,223 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second-mr] at least one sink is marked for delete
2015-05-20 17:48:37,223 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second-mr] sink oldest modified date: Wed Dec 31 15:59:59 PST 1969
2015-05-20 17:48:37,226 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second-mr] starting
2015-05-20 17:48:37,226 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second-mr]  source: Hfs["NullScheme"]["hdfs://localhost:51361/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/mapreduceflowplatform/flow1"]
2015-05-20 17:48:37,226 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second-mr]  sink: Hfs["NullScheme"]["hdfs://localhost:51361/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/mapreduceflowplatform/flow2"]
2015-05-20 17:48:37,227 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second-mr]  parallel execution is enabled: true
2015-05-20 17:48:37,227 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second-mr]  starting jobs: 1
2015-05-20 17:48:37,227 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second-mr]  allocating threads: 1
2015-05-20 17:48:37,227 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [second-mr] starting step: Hfs["NullScheme"]["hdfs://localhost:51361/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/mapreduceflowplatform/flow2"]
2015-05-20 17:48:37,252 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(153)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2015-05-20 17:48:37,254 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(261)) - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
2015-05-20 17:48:37,366 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [second-mr] submitted hadoop job: job_1432169232273_0005
2015-05-20 17:48:37,366 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [second-mr] tracking url: http://Edinburgh.local:51474/proxy/application_1432169232273_0005/
2015-05-20 17:48:50,935 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1432169232273_0005_01_000003 is : 143
2015-05-20 17:48:50,966 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1432169232273_0005_01_000002 is : 143
2015-05-20 17:48:51,120 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1432169232273_0005_01_000004 is : 143
2015-05-20 17:48:51,178 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1432169232273_0005_01_000005 is : 143
2015-05-20 17:48:56,161 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1432169232273_0005_01_000006 is : 143
2015-05-20 17:48:57,332 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path hdfs://localhost:51361/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/mapreduceflowplatform/flow2/_temporary
2015-05-20 17:48:57,333 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first-flow+second-flow...] completed flow: second-mr
2015-05-20 17:48:57,334 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first-flow+second-flow...] starting flow: third-mr
2015-05-20 17:48:57,334 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [third-mr] at least one sink is marked for delete
2015-05-20 17:48:57,334 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [third-mr] sink oldest modified date: Wed Dec 31 15:59:59 PST 1969
2015-05-20 17:48:57,337 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [third-mr] starting
2015-05-20 17:48:57,337 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [third-mr]  source: Hfs["NullScheme"]["hdfs://localhost:51361/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/mapreduceflowplatform/flow2"]
2015-05-20 17:48:57,337 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [third-mr]  sink: Hfs["NullScheme"]["hdfs://localhost:51361/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/mapreduceflowplatform/flow3"]
2015-05-20 17:48:57,338 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [third-mr]  parallel execution is enabled: true
2015-05-20 17:48:57,338 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [third-mr]  starting jobs: 1
2015-05-20 17:48:57,338 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [third-mr]  allocating threads: 1
2015-05-20 17:48:57,339 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [third-mr] starting step: Hfs["NullScheme"]["hdfs://localhost:51361/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/mapreduceflowplatform/flow3"]
2015-05-20 17:48:57,367 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(153)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2015-05-20 17:48:57,369 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(261)) - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
2015-05-20 17:48:57,451 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [third-mr] submitted hadoop job: job_1432169232273_0006
2015-05-20 17:48:57,451 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [third-mr] tracking url: http://Edinburgh.local:51474/proxy/application_1432169232273_0006/
2015-05-20 17:49:06,803 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1432169232273_0006_01_000002 is : 143
2015-05-20 17:49:11,719 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1432169232273_0006_01_000003 is : 143
2015-05-20 17:49:12,898 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path hdfs://localhost:51361/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/mapreduceflowplatform/flow3/_temporary
2015-05-20 17:49:12,899 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first-flow+second-flow...] completed flow: third-mr
2015-05-20 17:49:12,918 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output//hadoop2-mr1/mapreduceflowplatform/flow4
2015-05-20 17:49:12,931 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output//hadoop2-mr1/mapreduceflowplatform/flow3
2015-05-20 17:49:12,937 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output//hadoop2-mr1/mapreduceflowplatform/flow2
2015-05-20 17:49:12,943 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output//hadoop2-mr1/mapreduceflowplatform/flow1
2015-05-20 17:49:12,949 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output//hadoop2-mr1/mapreduceflowplatform/flow5

Standard error

Exception in thread "org.apache.hadoop.util.JvmPauseMonitor$Monitor@11228e46" java.lang.NoSuchMethodError: com.google.common.base.Stopwatch.elapsedMillis()J
	at org.apache.hadoop.util.JvmPauseMonitor$Monitor.run(JvmPauseMonitor.java:184)
	at java.lang.Thread.run(Thread.java:745)
Exception in thread "org.apache.hadoop.util.JvmPauseMonitor$Monitor@3c2ae8f6" java.lang.NoSuchMethodError: com.google.common.base.Stopwatch.elapsedMillis()J
	at org.apache.hadoop.util.JvmPauseMonitor$Monitor.run(JvmPauseMonitor.java:184)
	at java.lang.Thread.run(Thread.java:745)
Exception in thread "org.apache.hadoop.util.JvmPauseMonitor$Monitor@5ec01f72" java.lang.NoSuchMethodError: com.google.common.base.Stopwatch.elapsedMillis()J
	at org.apache.hadoop.util.JvmPauseMonitor$Monitor.run(JvmPauseMonitor.java:184)
	at java.lang.Thread.run(Thread.java:745)
Exception in thread "org.apache.hadoop.util.JvmPauseMonitor$Monitor@12738bc7" java.lang.NoSuchMethodError: com.google.common.base.Stopwatch.elapsedMillis()J
	at org.apache.hadoop.util.JvmPauseMonitor$Monitor.run(JvmPauseMonitor.java:184)
	at java.lang.Thread.run(Thread.java:745)
Exception in thread "org.apache.hadoop.util.JvmPauseMonitor$Monitor@6d47d006" java.lang.NoSuchMethodError: com.google.common.base.Stopwatch.elapsedMillis()J
	at org.apache.hadoop.util.JvmPauseMonitor$Monitor.run(JvmPauseMonitor.java:184)
	at java.lang.Thread.run(Thread.java:745)
May 20, 2015 5:47:12 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class
May 20, 2015 5:47:12 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class
May 20, 2015 5:47:12 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 20, 2015 5:47:12 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 20, 2015 5:47:12 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 20, 2015 5:47:12 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 20, 2015 5:47:13 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest"
May 20, 2015 5:47:13 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 20, 2015 5:47:13 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class
May 20, 2015 5:47:13 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class
May 20, 2015 5:47:13 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 20, 2015 5:47:13 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 20, 2015 5:47:13 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 20, 2015 5:47:14 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 20, 2015 5:47:14 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 20, 2015 5:47:14 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 20, 2015 5:47:14 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
May 20, 2015 5:47:14 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 20, 2015 5:47:14 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
May 20, 2015 5:47:14 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 20, 2015 5:47:14 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 20, 2015 5:47:14 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 20, 2015 5:47:15 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 20, 2015 5:47:15 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 20, 2015 5:47:15 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
May 20, 2015 5:47:15 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 20, 2015 5:47:15 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
May 20, 2015 5:47:15 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 20, 2015 5:47:15 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 20, 2015 5:47:15 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 20, 2015 5:47:16 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 20, 2015 5:47:16 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 20, 2015 5:47:16 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
May 20, 2015 5:47:16 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 20, 2015 5:47:16 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
May 20, 2015 5:47:16 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 20, 2015 5:47:16 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 20, 2015 5:47:16 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 20, 2015 5:47:17 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 20, 2015 5:47:17 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.