Class cascading.flow.hadoop.MapReduceFlowPlatformTest

2

tests

0

failures

0

ignored

2m20.42s

duration

100%

successful

Tests

Test Duration Result
testCascade 1m35.95s passed
testFlow 44.475s passed

Standard output

2015-07-17 15:22:30,706 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(187)) - found 1 test platforms from classpath
2015-07-17 15:22:30,717 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(237)) - installing platform: hadoop2-mr1
2015-07-17 15:22:30,718 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(238)) - running test: cascading.flow.hadoop.MapReduceFlowPlatformTest
2015-07-17 15:22:30,735 INFO  hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(121)) - using cluster
2015-07-17 15:22:31,489 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
2015-07-17 15:22:31,961 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2015-07-17 15:22:35,532 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-07-17 15:22:35,739 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-07-17 15:22:35,925 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-07-17 15:22:36,122 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-07-17 15:22:53,286 INFO  platform.TestPlatform (TestPlatform.java:getGlobalProperties(72)) - platform property overrides: 
2015-07-17 15:22:53,341 INFO  property.AppProps (AppProps.java:getAppID(169)) - using app.id: 48E73ED4529D46E286EF5CC142C9670A
2015-07-17 15:22:53,466 INFO  util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 2.7.0
2015-07-17 15:22:53,468 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [mrflow] starting
2015-07-17 15:22:53,468 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [mrflow]  source: Hfs["NullScheme"]["hdfs://localhost:60380/Users/castillo/code/cascading.compatibility-2.7/microsoft-hdi-3.2/build/classes/test/data/apache.10.txt"]
2015-07-17 15:22:53,469 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [mrflow]  sink: Hfs["NullScheme"]["hdfs://localhost:60380/Users/castillo/code/cascading.compatibility-2.7/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/mapreduceflowplatform/flowTest"]
2015-07-17 15:22:53,470 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [mrflow]  parallel execution is enabled: true
2015-07-17 15:22:53,470 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [mrflow]  starting jobs: 1
2015-07-17 15:22:53,470 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [mrflow]  allocating threads: 1
2015-07-17 15:22:53,471 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [mrflow] starting step: Hfs["NullScheme"]["hdfs://localhost:60380/Users/castillo/code/cascading.compatibility-2.7/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/mapreduceflowplatform/flowTest"]
2015-07-17 15:22:53,608 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(153)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2015-07-17 15:22:53,612 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(261)) - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
2015-07-17 15:22:54,198 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [mrflow] submitted hadoop job: job_1437171767755_0001
2015-07-17 15:22:54,198 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [mrflow] tracking url: http://Marks-MacBook.local:60425/proxy/application_1437171767755_0001/
2015-07-17 15:23:08,410 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1437171767755_0001_01_000005 is : 143
2015-07-17 15:23:08,532 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1437171767755_0001_01_000004 is : 143
2015-07-17 15:23:08,573 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1437171767755_0001_01_000002 is : 143
2015-07-17 15:23:08,606 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1437171767755_0001_01_000003 is : 143
2015-07-17 15:23:13,905 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1437171767755_0001_01_000006 is : 143
2015-07-17 15:23:15,169 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path hdfs://localhost:60380/Users/castillo/code/cascading.compatibility-2.7/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/mapreduceflowplatform/flowTest/_temporary
2015-07-17 15:23:15,197 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/castillo/code/cascading.compatibility-2.7/microsoft-hdi-3.2/build/test/output//hadoop2-mr1/mapreduceflowplatform/flowTest
2015-07-17 15:23:15,271 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-07-17 15:23:15,273 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/castillo/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-07-17 15:23:15,361 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-07-17 15:23:15,362 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/castillo/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-07-17 15:23:15,531 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first-flow+second-flow...] starting
2015-07-17 15:23:15,534 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first-flow+second-flow...]  parallel execution is enabled: true
2015-07-17 15:23:15,535 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first-flow+second-flow...]  starting flows: 5
2015-07-17 15:23:15,535 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first-flow+second-flow...]  allocating threads: 5
2015-07-17 15:23:15,536 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first-flow+second-flow...] starting flow: first-flow
2015-07-17 15:23:15,537 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first-flow] at least one sink is marked for delete
2015-07-17 15:23:15,537 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first-flow] sink oldest modified date: Wed Dec 31 15:59:59 PST 1969
2015-07-17 15:23:15,541 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first-flow] starting
2015-07-17 15:23:15,541 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first-flow]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility-2.7/microsoft-hdi-3.2/build/classes/test/data/apache.10.txt"]
2015-07-17 15:23:15,541 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first-flow]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility-2.7/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/mapreduceflowplatform/flow4"]
2015-07-17 15:23:15,541 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first-flow]  parallel execution is enabled: true
2015-07-17 15:23:15,541 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first-flow]  starting jobs: 1
2015-07-17 15:23:15,541 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first-flow]  allocating threads: 1
2015-07-17 15:23:15,542 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [first-flow] starting step: (1/1) ...preduceflowplatform/flow4
2015-07-17 15:23:15,724 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [first-flow] submitted hadoop job: job_1437171767755_0002
2015-07-17 15:23:15,724 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [first-flow] tracking url: http://Marks-MacBook.local:60425/proxy/application_1437171767755_0002/
2015-07-17 15:23:30,087 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1437171767755_0002_01_000004 is : 143
2015-07-17 15:23:30,197 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1437171767755_0002_01_000005 is : 143
2015-07-17 15:23:30,311 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1437171767755_0002_01_000003 is : 143
2015-07-17 15:23:30,346 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1437171767755_0002_01_000002 is : 143
2015-07-17 15:23:31,568 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/castillo/code/cascading.compatibility-2.7/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/mapreduceflowplatform/flow4/_temporary
2015-07-17 15:23:31,572 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first-flow+second-flow...] completed flow: first-flow
2015-07-17 15:23:31,572 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first-flow+second-flow...] starting flow: second-flow
2015-07-17 15:23:31,573 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second-flow] at least one sink is marked for delete
2015-07-17 15:23:31,573 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second-flow] sink oldest modified date: Wed Dec 31 15:59:59 PST 1969
2015-07-17 15:23:31,577 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second-flow] starting
2015-07-17 15:23:31,577 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second-flow]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility-2.7/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/mapreduceflowplatform/flow4"]
2015-07-17 15:23:31,577 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second-flow]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility-2.7/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/mapreduceflowplatform/flow5"]
2015-07-17 15:23:31,578 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second-flow]  parallel execution is enabled: true
2015-07-17 15:23:31,578 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second-flow]  starting jobs: 1
2015-07-17 15:23:31,578 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second-flow]  allocating threads: 1
2015-07-17 15:23:31,579 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [second-flow] starting step: (1/1) ...preduceflowplatform/flow5
2015-07-17 15:23:31,732 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [second-flow] submitted hadoop job: job_1437171767755_0003
2015-07-17 15:23:31,732 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [second-flow] tracking url: http://Marks-MacBook.local:60425/proxy/application_1437171767755_0003/
2015-07-17 15:23:48,027 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1437171767755_0003_01_000005 is : 143
2015-07-17 15:23:48,247 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1437171767755_0003_01_000004 is : 143
2015-07-17 15:23:48,494 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1437171767755_0003_01_000006 is : 143
2015-07-17 15:23:48,517 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1437171767755_0003_01_000002 is : 143
2015-07-17 15:23:48,569 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1437171767755_0003_01_000003 is : 143
2015-07-17 15:23:49,822 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/castillo/code/cascading.compatibility-2.7/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/mapreduceflowplatform/flow5/_temporary
2015-07-17 15:23:49,823 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first-flow+second-flow...] completed flow: second-flow
2015-07-17 15:23:49,824 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first-flow+second-flow...] starting flow: first-mr
2015-07-17 15:23:49,825 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first-mr] at least one sink is marked for delete
2015-07-17 15:23:49,825 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first-mr] sink oldest modified date: Wed Dec 31 15:59:59 PST 1969
2015-07-17 15:23:49,831 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first-mr] starting
2015-07-17 15:23:49,831 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first-mr]  source: Hfs["NullScheme"]["hdfs://localhost:60380/Users/castillo/code/cascading.compatibility-2.7/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/mapreduceflowplatform/flow5"]
2015-07-17 15:23:49,831 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first-mr]  sink: Hfs["NullScheme"]["hdfs://localhost:60380/Users/castillo/code/cascading.compatibility-2.7/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/mapreduceflowplatform/flow1"]
2015-07-17 15:23:49,832 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first-mr]  parallel execution is enabled: true
2015-07-17 15:23:49,832 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first-mr]  starting jobs: 1
2015-07-17 15:23:49,832 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first-mr]  allocating threads: 1
2015-07-17 15:23:49,833 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [first-mr] starting step: Hfs["NullScheme"]["hdfs://localhost:60380/Users/castillo/code/cascading.compatibility-2.7/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/mapreduceflowplatform/flow1"]
2015-07-17 15:23:49,859 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(153)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2015-07-17 15:23:49,862 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(261)) - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
2015-07-17 15:23:49,947 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [first-mr] submitted hadoop job: job_1437171767755_0004
2015-07-17 15:23:49,947 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [first-mr] tracking url: http://Marks-MacBook.local:60425/proxy/application_1437171767755_0004/
2015-07-17 15:24:07,405 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1437171767755_0004_01_000006 is : 143
2015-07-17 15:24:07,597 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1437171767755_0004_01_000007 is : 143
2015-07-17 15:24:07,637 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1437171767755_0004_01_000004 is : 143
2015-07-17 15:24:07,699 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1437171767755_0004_01_000002 is : 143
2015-07-17 15:24:07,743 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1437171767755_0004_01_000003 is : 143
2015-07-17 15:24:07,767 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1437171767755_0004_01_000005 is : 143
2015-07-17 15:24:12,883 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1437171767755_0004_01_000008 is : 143
2015-07-17 15:24:14,097 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path hdfs://localhost:60380/Users/castillo/code/cascading.compatibility-2.7/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/mapreduceflowplatform/flow1/_temporary
2015-07-17 15:24:14,098 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first-flow+second-flow...] completed flow: first-mr
2015-07-17 15:24:14,098 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first-flow+second-flow...] starting flow: second-mr
2015-07-17 15:24:14,098 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second-mr] at least one sink is marked for delete
2015-07-17 15:24:14,099 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second-mr] sink oldest modified date: Wed Dec 31 15:59:59 PST 1969
2015-07-17 15:24:14,101 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second-mr] starting
2015-07-17 15:24:14,102 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second-mr]  source: Hfs["NullScheme"]["hdfs://localhost:60380/Users/castillo/code/cascading.compatibility-2.7/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/mapreduceflowplatform/flow1"]
2015-07-17 15:24:14,102 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second-mr]  sink: Hfs["NullScheme"]["hdfs://localhost:60380/Users/castillo/code/cascading.compatibility-2.7/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/mapreduceflowplatform/flow2"]
2015-07-17 15:24:14,102 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second-mr]  parallel execution is enabled: true
2015-07-17 15:24:14,102 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second-mr]  starting jobs: 1
2015-07-17 15:24:14,102 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second-mr]  allocating threads: 1
2015-07-17 15:24:14,103 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [second-mr] starting step: Hfs["NullScheme"]["hdfs://localhost:60380/Users/castillo/code/cascading.compatibility-2.7/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/mapreduceflowplatform/flow2"]
2015-07-17 15:24:14,128 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(153)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2015-07-17 15:24:14,130 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(261)) - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
2015-07-17 15:24:14,233 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [second-mr] submitted hadoop job: job_1437171767755_0005
2015-07-17 15:24:14,233 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [second-mr] tracking url: http://Marks-MacBook.local:60425/proxy/application_1437171767755_0005/
2015-07-17 15:24:28,429 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1437171767755_0005_01_000003 is : 143
2015-07-17 15:24:28,493 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1437171767755_0005_01_000002 is : 143
2015-07-17 15:24:28,662 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1437171767755_0005_01_000004 is : 143
2015-07-17 15:24:28,729 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1437171767755_0005_01_000005 is : 143
2015-07-17 15:24:34,108 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1437171767755_0005_01_000006 is : 143
2015-07-17 15:24:35,285 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path hdfs://localhost:60380/Users/castillo/code/cascading.compatibility-2.7/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/mapreduceflowplatform/flow2/_temporary
2015-07-17 15:24:35,286 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first-flow+second-flow...] completed flow: second-mr
2015-07-17 15:24:35,286 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first-flow+second-flow...] starting flow: third-mr
2015-07-17 15:24:35,287 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [third-mr] at least one sink is marked for delete
2015-07-17 15:24:35,287 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [third-mr] sink oldest modified date: Wed Dec 31 15:59:59 PST 1969
2015-07-17 15:24:35,290 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [third-mr] starting
2015-07-17 15:24:35,290 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [third-mr]  source: Hfs["NullScheme"]["hdfs://localhost:60380/Users/castillo/code/cascading.compatibility-2.7/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/mapreduceflowplatform/flow2"]
2015-07-17 15:24:35,290 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [third-mr]  sink: Hfs["NullScheme"]["hdfs://localhost:60380/Users/castillo/code/cascading.compatibility-2.7/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/mapreduceflowplatform/flow3"]
2015-07-17 15:24:35,290 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [third-mr]  parallel execution is enabled: true
2015-07-17 15:24:35,290 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [third-mr]  starting jobs: 1
2015-07-17 15:24:35,290 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [third-mr]  allocating threads: 1
2015-07-17 15:24:35,291 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [third-mr] starting step: Hfs["NullScheme"]["hdfs://localhost:60380/Users/castillo/code/cascading.compatibility-2.7/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/mapreduceflowplatform/flow3"]
2015-07-17 15:24:35,322 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(153)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2015-07-17 15:24:35,324 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(261)) - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
2015-07-17 15:24:35,419 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [third-mr] submitted hadoop job: job_1437171767755_0006
2015-07-17 15:24:35,419 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [third-mr] tracking url: http://Marks-MacBook.local:60425/proxy/application_1437171767755_0006/
2015-07-17 15:24:44,585 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1437171767755_0006_01_000002 is : 143
2015-07-17 15:24:49,869 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1437171767755_0006_01_000003 is : 143
2015-07-17 15:24:51,062 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path hdfs://localhost:60380/Users/castillo/code/cascading.compatibility-2.7/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/mapreduceflowplatform/flow3/_temporary
2015-07-17 15:24:51,063 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first-flow+second-flow...] completed flow: third-mr
2015-07-17 15:24:51,081 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/castillo/code/cascading.compatibility-2.7/microsoft-hdi-3.2/build/test/output//hadoop2-mr1/mapreduceflowplatform/flow2
2015-07-17 15:24:51,090 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/castillo/code/cascading.compatibility-2.7/microsoft-hdi-3.2/build/test/output//hadoop2-mr1/mapreduceflowplatform/flow1
2015-07-17 15:24:51,099 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/castillo/code/cascading.compatibility-2.7/microsoft-hdi-3.2/build/test/output//hadoop2-mr1/mapreduceflowplatform/flow4
2015-07-17 15:24:51,122 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/castillo/code/cascading.compatibility-2.7/microsoft-hdi-3.2/build/test/output//hadoop2-mr1/mapreduceflowplatform/flow3
2015-07-17 15:24:51,131 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/castillo/code/cascading.compatibility-2.7/microsoft-hdi-3.2/build/test/output//hadoop2-mr1/mapreduceflowplatform/flow5

Standard error

SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/Users/castillo/code/cascading.compatibility-2.7/microsoft-hdi-3.2/hadoop/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/Users/castillo/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.5/6edffc576ce104ec769d954618764f39f0f0f10d/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
Jul 17, 2015 3:22:48 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class
Jul 17, 2015 3:22:48 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class
Jul 17, 2015 3:22:48 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Jul 17, 2015 3:22:48 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Jul 17, 2015 3:22:48 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Jul 17, 2015 3:22:48 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Jul 17, 2015 3:22:48 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest"
Jul 17, 2015 3:22:48 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Jul 17, 2015 3:22:49 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class
Jul 17, 2015 3:22:49 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class
Jul 17, 2015 3:22:49 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Jul 17, 2015 3:22:49 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Jul 17, 2015 3:22:49 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Jul 17, 2015 3:22:49 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Jul 17, 2015 3:22:49 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Jul 17, 2015 3:22:49 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Jul 17, 2015 3:22:50 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
Jul 17, 2015 3:22:50 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Jul 17, 2015 3:22:50 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
Jul 17, 2015 3:22:50 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Jul 17, 2015 3:22:50 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Jul 17, 2015 3:22:50 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Jul 17, 2015 3:22:50 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Jul 17, 2015 3:22:50 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Jul 17, 2015 3:22:51 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
Jul 17, 2015 3:22:51 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Jul 17, 2015 3:22:51 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
Jul 17, 2015 3:22:51 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Jul 17, 2015 3:22:51 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Jul 17, 2015 3:22:51 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Jul 17, 2015 3:22:51 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Jul 17, 2015 3:22:51 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Jul 17, 2015 3:22:52 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
Jul 17, 2015 3:22:52 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Jul 17, 2015 3:22:52 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
Jul 17, 2015 3:22:52 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Jul 17, 2015 3:22:52 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Jul 17, 2015 3:22:52 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Jul 17, 2015 3:22:52 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Jul 17, 2015 3:22:52 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.