Class cascading.flow.hadoop.MapReduceFlowPlatformTest

2

tests

0

failures

0

ignored

5m53.30s

duration

100%

successful

Tests

Test Duration Result
testCascade 4m18.03s passed
testFlow 1m35.27s passed

Standard output

2015-09-24 13:54:12,203 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(195)) - found 1 test platforms from classpath
2015-09-24 13:54:12,235 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(244)) - adding test: cascading.flow.hadoop.MapReduceFlowPlatformTest, with platform: hadoop2-mr1
2015-09-24 13:54:12,254 INFO  hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(136)) - using cluster
2015-09-24 13:54:24,612 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
2015-09-24 13:54:25,251 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2015-09-24 13:54:29,831 WARN  fair.AllocationFileLoaderService (AllocationFileLoaderService.java:getAllocationFile(179)) - fair-scheduler.xml not found on the classpath.
2015-09-24 13:54:30,185 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-09-24 13:54:30,449 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-09-24 13:54:30,685 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-09-24 13:54:30,922 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-09-24 13:54:48,047 INFO  platform.TestPlatform (TestPlatform.java:getGlobalProperties(73)) - platform property overrides: 
2015-09-24 13:54:48,126 INFO  property.AppProps (AppProps.java:getAppID(177)) - using app.id: B0F767E81FD148888198B23D18A0FF3E
2015-09-24 13:54:48,358 INFO  util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.0.2
2015-09-24 13:54:48,361 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mrflow] starting
2015-09-24 13:54:48,362 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mrflow]  source: Hfs["NullScheme"]["hdfs://localhost:62178/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/classes/test/data/apache.10.txt"]
2015-09-24 13:54:48,362 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mrflow]  sink: Hfs["NullScheme"]["hdfs://localhost:62178/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/mapreduceflowplatform/testFlow/flowTest"]
2015-09-24 13:54:48,364 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mrflow]  parallel execution of steps is enabled: true
2015-09-24 13:54:48,364 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mrflow]  executing total steps: 1
2015-09-24 13:54:48,365 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mrflow]  allocating management threads: 1
2015-09-24 13:54:48,366 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mrflow] starting step: Hfs["NullScheme"]["hdfs://localhost:62178/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/mapreduceflowplatform/testFlow/flowTest"]
2015-09-24 13:54:48,555 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(153)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2015-09-24 13:54:48,560 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(261)) - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
2015-09-24 13:54:49,266 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mrflow] submitted hadoop job: job_1443117282528_0001
2015-09-24 13:54:49,267 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mrflow] tracking url: http://localhost:62206/proxy/application_1443117282528_0001/
2015-09-24 13:55:28,732 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1443117282528_0001_01_000003 is : 143
2015-09-24 13:55:28,743 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1443117282528_0001_01_000004 is : 143
2015-09-24 13:55:28,905 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1443117282528_0001_01_000002 is : 143
2015-09-24 13:55:28,972 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1443117282528_0001_01_000005 is : 143
2015-09-24 13:55:46,179 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1443117282528_0001_01_000006 is : 143
2015-09-24 13:55:47,478 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path hdfs://localhost:62178/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/mapreduceflowplatform/testFlow/flowTest/_temporary
2015-09-24 13:55:47,481 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mrflow]  completed in: 00:59.110
2015-09-24 13:55:47,510 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/mapreduceflowplatform/testFlow/flowTest
2015-09-24 13:55:47,584 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-09-24 13:55:47,586 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /Users/ryan/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-09-24 13:55:47,715 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.056
2015-09-24 13:55:47,718 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2015-09-24 13:55:47,718 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-09-24 13:55:47,839 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-09-24 13:55:47,839 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /Users/ryan/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-09-24 13:55:47,883 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.037
2015-09-24 13:55:47,884 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2015-09-24 13:55:47,885 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-09-24 13:55:48,104 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] starting
2015-09-24 13:55:48,108 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...]  parallel execution of flows is enabled: true
2015-09-24 13:55:48,108 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...]  executing total flows: 5
2015-09-24 13:55:48,109 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...]  allocating management threads: 5
2015-09-24 13:55:48,110 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] starting flow: first-flow
2015-09-24 13:55:48,111 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow] at least one sink is marked for delete
2015-09-24 13:55:48,111 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow] sink oldest modified date: Wed Dec 31 18:59:59 EST 1969
2015-09-24 13:55:48,117 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow] starting
2015-09-24 13:55:48,118 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/classes/test/data/apache.10.txt"]
2015-09-24 13:55:48,118 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow4"]
2015-09-24 13:55:48,118 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow]  parallel execution of steps is enabled: true
2015-09-24 13:55:48,119 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow]  executing total steps: 1
2015-09-24 13:55:48,119 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow]  allocating management threads: 1
2015-09-24 13:55:48,120 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow] starting step: (1/1) ...latform/testCascade/flow4
2015-09-24 13:55:48,357 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow] submitted hadoop job: job_1443117282528_0002
2015-09-24 13:55:48,357 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow] tracking url: http://localhost:62206/proxy/application_1443117282528_0002/
2015-09-24 13:56:28,161 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1443117282528_0002_01_000003 is : 143
2015-09-24 13:56:28,162 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1443117282528_0002_01_000005 is : 143
2015-09-24 13:56:28,224 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1443117282528_0002_01_000004 is : 143
2015-09-24 13:56:28,302 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1443117282528_0002_01_000002 is : 143
2015-09-24 13:56:29,576 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow4/_temporary
2015-09-24 13:56:29,579 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow]  completed in: 00:41.456
2015-09-24 13:56:29,580 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] completed flow: first-flow
2015-09-24 13:56:29,580 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] starting flow: second-flow
2015-09-24 13:56:29,581 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow] at least one sink is marked for delete
2015-09-24 13:56:29,581 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow] sink oldest modified date: Wed Dec 31 18:59:59 EST 1969
2015-09-24 13:56:29,587 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow] starting
2015-09-24 13:56:29,587 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow4"]
2015-09-24 13:56:29,587 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow5"]
2015-09-24 13:56:29,587 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow]  parallel execution of steps is enabled: true
2015-09-24 13:56:29,588 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow]  executing total steps: 1
2015-09-24 13:56:29,588 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow]  allocating management threads: 1
2015-09-24 13:56:29,589 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow] starting step: (1/1) ...latform/testCascade/flow5
2015-09-24 13:56:29,772 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow] submitted hadoop job: job_1443117282528_0003
2015-09-24 13:56:29,772 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow] tracking url: http://localhost:62206/proxy/application_1443117282528_0003/
2015-09-24 13:56:51,288 WARN  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1065)) - Event EventType: KILL_CONTAINER sent to absent container container_1443117282528_0003_01_000007
2015-09-24 13:57:11,792 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1443117282528_0003_01_000002 is : 143
2015-09-24 13:57:11,826 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1443117282528_0003_01_000005 is : 143
2015-09-24 13:57:11,917 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1443117282528_0003_01_000004 is : 143
2015-09-24 13:57:11,957 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1443117282528_0003_01_000006 is : 143
2015-09-24 13:57:12,019 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1443117282528_0003_01_000003 is : 143
2015-09-24 13:57:13,281 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow5/_temporary
2015-09-24 13:57:13,283 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow]  completed in: 00:43.690
2015-09-24 13:57:13,284 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] completed flow: second-flow
2015-09-24 13:57:13,284 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] starting flow: first-mr
2015-09-24 13:57:13,284 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-mr] at least one sink is marked for delete
2015-09-24 13:57:13,285 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-mr] sink oldest modified date: Wed Dec 31 18:59:59 EST 1969
2015-09-24 13:57:13,289 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-mr] starting
2015-09-24 13:57:13,290 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-mr]  source: Hfs["NullScheme"]["hdfs://localhost:62178/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow5"]
2015-09-24 13:57:13,290 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-mr]  sink: Hfs["NullScheme"]["hdfs://localhost:62178/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow1"]
2015-09-24 13:57:13,291 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-mr]  parallel execution of steps is enabled: true
2015-09-24 13:57:13,291 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-mr]  executing total steps: 1
2015-09-24 13:57:13,291 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-mr]  allocating management threads: 1
2015-09-24 13:57:13,292 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-mr] starting step: Hfs["NullScheme"]["hdfs://localhost:62178/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow1"]
2015-09-24 13:57:13,334 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(153)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2015-09-24 13:57:13,338 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(261)) - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
2015-09-24 13:57:13,458 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-mr] submitted hadoop job: job_1443117282528_0004
2015-09-24 13:57:13,459 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-mr] tracking url: http://localhost:62206/proxy/application_1443117282528_0004/
2015-09-24 13:57:34,875 WARN  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1065)) - Event EventType: KILL_CONTAINER sent to absent container container_1443117282528_0004_01_000009
2015-09-24 13:57:34,968 WARN  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1065)) - Event EventType: KILL_CONTAINER sent to absent container container_1443117282528_0004_01_000010
2015-09-24 13:57:56,299 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1443117282528_0004_01_000003 is : 143
2015-09-24 13:57:56,306 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1443117282528_0004_01_000004 is : 143
2015-09-24 13:57:56,591 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1443117282528_0004_01_000006 is : 143
2015-09-24 13:57:56,637 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1443117282528_0004_01_000002 is : 143
2015-09-24 13:57:56,644 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1443117282528_0004_01_000005 is : 143
2015-09-24 13:57:56,753 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1443117282528_0004_01_000007 is : 143
2015-09-24 13:58:13,729 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1443117282528_0004_01_000011 is : 143
2015-09-24 13:58:14,954 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path hdfs://localhost:62178/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow1/_temporary
2015-09-24 13:58:14,957 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-mr]  completed in: 01:01.661
2015-09-24 13:58:14,957 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] completed flow: first-mr
2015-09-24 13:58:14,957 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] starting flow: second-mr
2015-09-24 13:58:14,957 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-mr] at least one sink is marked for delete
2015-09-24 13:58:14,958 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-mr] sink oldest modified date: Wed Dec 31 18:59:59 EST 1969
2015-09-24 13:58:14,962 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-mr] starting
2015-09-24 13:58:14,962 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-mr]  source: Hfs["NullScheme"]["hdfs://localhost:62178/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow1"]
2015-09-24 13:58:14,962 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-mr]  sink: Hfs["NullScheme"]["hdfs://localhost:62178/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow2"]
2015-09-24 13:58:14,963 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-mr]  parallel execution of steps is enabled: true
2015-09-24 13:58:14,963 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-mr]  executing total steps: 1
2015-09-24 13:58:14,963 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-mr]  allocating management threads: 1
2015-09-24 13:58:14,964 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-mr] starting step: Hfs["NullScheme"]["hdfs://localhost:62178/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow2"]
2015-09-24 13:58:14,999 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(153)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2015-09-24 13:58:15,003 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(261)) - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
2015-09-24 13:58:15,144 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-mr] submitted hadoop job: job_1443117282528_0005
2015-09-24 13:58:15,144 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-mr] tracking url: http://localhost:62206/proxy/application_1443117282528_0005/
2015-09-24 13:58:53,783 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1443117282528_0005_01_000005 is : 143
2015-09-24 13:58:53,842 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1443117282528_0005_01_000004 is : 143
2015-09-24 13:58:53,931 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1443117282528_0005_01_000003 is : 143
2015-09-24 13:58:54,079 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1443117282528_0005_01_000002 is : 143
2015-09-24 13:59:11,832 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1443117282528_0005_01_000006 is : 143
2015-09-24 13:59:13,047 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path hdfs://localhost:62178/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow2/_temporary
2015-09-24 13:59:13,049 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-mr]  completed in: 00:58.082
2015-09-24 13:59:13,050 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] completed flow: second-mr
2015-09-24 13:59:13,050 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] starting flow: third-mr
2015-09-24 13:59:13,050 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third-mr] at least one sink is marked for delete
2015-09-24 13:59:13,051 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third-mr] sink oldest modified date: Wed Dec 31 18:59:59 EST 1969
2015-09-24 13:59:13,054 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third-mr] starting
2015-09-24 13:59:13,055 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third-mr]  source: Hfs["NullScheme"]["hdfs://localhost:62178/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow2"]
2015-09-24 13:59:13,056 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third-mr]  sink: Hfs["NullScheme"]["hdfs://localhost:62178/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow3"]
2015-09-24 13:59:13,056 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third-mr]  parallel execution of steps is enabled: true
2015-09-24 13:59:13,056 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third-mr]  executing total steps: 1
2015-09-24 13:59:13,056 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third-mr]  allocating management threads: 1
2015-09-24 13:59:13,057 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third-mr] starting step: Hfs["NullScheme"]["hdfs://localhost:62178/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow3"]
2015-09-24 13:59:13,087 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(153)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2015-09-24 13:59:13,090 WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(261)) - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
2015-09-24 13:59:13,211 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third-mr] submitted hadoop job: job_1443117282528_0006
2015-09-24 13:59:13,211 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third-mr] tracking url: http://localhost:62206/proxy/application_1443117282528_0006/
2015-09-24 13:59:46,857 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1443117282528_0006_01_000002 is : 143
2015-09-24 14:00:04,220 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1443117282528_0006_01_000003 is : 143
2015-09-24 14:00:05,452 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path hdfs://localhost:62178/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow3/_temporary
2015-09-24 14:00:05,454 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third-mr]  completed in: 00:52.395
2015-09-24 14:00:05,455 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] completed flow: third-mr
2015-09-24 14:00:05,482 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/mapreduceflowplatform/testCascade/flow4
2015-09-24 14:00:05,504 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/mapreduceflowplatform/testCascade/flow5
2015-09-24 14:00:05,528 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/mapreduceflowplatform/testCascade/flow2
2015-09-24 14:00:05,536 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/mapreduceflowplatform/testCascade/flow3
2015-09-24 14:00:05,545 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/mapreduceflowplatform/testCascade/flow1

Standard error

Sep 24, 2015 1:54:42 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class
Sep 24, 2015 1:54:42 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class
Sep 24, 2015 1:54:42 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Sep 24, 2015 1:54:42 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Sep 24, 2015 1:54:42 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Sep 24, 2015 1:54:43 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Sep 24, 2015 1:54:43 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest"
Sep 24, 2015 1:54:43 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Sep 24, 2015 1:54:44 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class
Sep 24, 2015 1:54:44 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class
Sep 24, 2015 1:54:44 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Sep 24, 2015 1:54:44 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Sep 24, 2015 1:54:44 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Sep 24, 2015 1:54:44 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Sep 24, 2015 1:54:44 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Sep 24, 2015 1:54:44 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Sep 24, 2015 1:54:45 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
Sep 24, 2015 1:54:45 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Sep 24, 2015 1:54:45 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
Sep 24, 2015 1:54:45 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Sep 24, 2015 1:54:45 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Sep 24, 2015 1:54:45 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Sep 24, 2015 1:54:45 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Sep 24, 2015 1:54:45 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Sep 24, 2015 1:54:46 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
Sep 24, 2015 1:54:46 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Sep 24, 2015 1:54:46 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
Sep 24, 2015 1:54:46 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Sep 24, 2015 1:54:46 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Sep 24, 2015 1:54:46 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Sep 24, 2015 1:54:46 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Sep 24, 2015 1:54:46 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Sep 24, 2015 1:54:47 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
Sep 24, 2015 1:54:47 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Sep 24, 2015 1:54:47 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
Sep 24, 2015 1:54:47 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Sep 24, 2015 1:54:47 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Sep 24, 2015 1:54:47 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Sep 24, 2015 1:54:47 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Sep 24, 2015 1:54:47 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.