Class cascading.flow.hadoop.MapReduceFlowPlatformTest

2

tests

0

failures

0

ignored

2m10.21s

duration

100%

successful

Tests

Test Duration Result
testCascade 1m32.22s passed
testFlow 37.987s passed

Standard output

2015-11-23 16:38:20,933 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(195)) - found 1 test platforms from classpath
2015-11-23 16:38:20,942 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(244)) - adding test: cascading.flow.hadoop.MapReduceFlowPlatformTest, with platform: hadoop2-mr1
2015-11-23 16:38:20,952 INFO  hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(136)) - using cluster
2015-11-23 16:38:21,516 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
2015-11-23 16:38:22,143 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(125)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2015-11-23 16:38:25,914 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-11-23 16:38:26,121 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-11-23 16:38:26,307 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-11-23 16:38:26,500 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-11-23 16:38:43,598 INFO  platform.TestPlatform (TestPlatform.java:getGlobalProperties(73)) - platform property overrides: 
2015-11-23 16:38:43,712 INFO  property.AppProps (AppProps.java:getAppID(177)) - using app.id: 58CDE3DC24D34E07956F121CAA9E11C3
2015-11-23 16:38:43,890 INFO  util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.0.2
2015-11-23 16:38:43,893 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mrflow] starting
2015-11-23 16:38:43,894 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mrflow]  source: Hfs["NullScheme"]["hdfs://localhost:41395/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/apache.10.txt"]
2015-11-23 16:38:43,894 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mrflow]  sink: Hfs["NullScheme"]["hdfs://localhost:41395/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/mapreduceflowplatform/testFlow/flowTest"]
2015-11-23 16:38:43,896 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mrflow]  parallel execution of steps is enabled: true
2015-11-23 16:38:43,897 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mrflow]  executing total steps: 1
2015-11-23 16:38:43,897 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mrflow]  allocating management threads: 1
2015-11-23 16:38:43,899 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mrflow] starting step: Hfs["NullScheme"]["hdfs://localhost:41395/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/mapreduceflowplatform/testFlow/flowTest"]
2015-11-23 16:38:44,201 WARN  mapreduce.JobResourceUploader (JobResourceUploader.java:uploadFiles(64)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2015-11-23 16:38:44,205 WARN  mapreduce.JobResourceUploader (JobResourceUploader.java:uploadFiles(171)) - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
2015-11-23 16:38:44,831 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mrflow] submitted hadoop job: job_1448267918096_0001
2015-11-23 16:38:44,832 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mrflow] tracking url: http://shihc046-public.cn.ibm.com:37618/proxy/application_1448267918096_0001/
2015-11-23 16:38:53,347 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448267918096_0001_01_000002 is : 143
2015-11-23 16:38:53,705 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448267918096_0001_01_000005 is : 143
2015-11-23 16:38:53,738 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448267918096_0001_01_000004 is : 143
2015-11-23 16:38:57,642 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448267918096_0001_01_000006 is : 143
2015-11-23 16:38:58,899 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path hdfs://localhost:41395/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/mapreduceflowplatform/testFlow/flowTest/_temporary
2015-11-23 16:38:58,903 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mrflow]  completed in: 00:15.003, using cpu time: 00:02.360
2015-11-23 16:38:58,928 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/mapreduceflowplatform/testFlow/flowTest
2015-11-23 16:38:58,982 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:38:58,983 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:38:59,066 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.036
2015-11-23 16:38:59,068 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2015-11-23 16:38:59,068 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:38:59,147 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:38:59,148 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:38:59,169 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.017
2015-11-23 16:38:59,170 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2015-11-23 16:38:59,170 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:38:59,292 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] starting
2015-11-23 16:38:59,300 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...]  parallel execution of flows is enabled: true
2015-11-23 16:38:59,301 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...]  executing total flows: 5
2015-11-23 16:38:59,301 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...]  allocating management threads: 5
2015-11-23 16:38:59,301 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] starting flow: first-flow
2015-11-23 16:38:59,303 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow] at least one sink is marked for delete
2015-11-23 16:38:59,303 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow] sink oldest modified date: Thu Jan 01 07:59:59 CST 1970
2015-11-23 16:38:59,309 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow] starting
2015-11-23 16:38:59,309 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/apache.10.txt"]
2015-11-23 16:38:59,309 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow4"]
2015-11-23 16:38:59,309 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow]  parallel execution of steps is enabled: true
2015-11-23 16:38:59,310 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow]  executing total steps: 1
2015-11-23 16:38:59,310 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow]  allocating management threads: 1
2015-11-23 16:38:59,312 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow] starting step: (1/1) ...latform/testCascade/flow4
2015-11-23 16:38:59,690 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow] submitted hadoop job: job_1448267918096_0002
2015-11-23 16:38:59,690 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow] tracking url: http://shihc046-public.cn.ibm.com:37618/proxy/application_1448267918096_0002/
2015-11-23 16:39:14,429 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448267918096_0002_01_000005 is : 143
2015-11-23 16:39:14,453 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448267918096_0002_01_000004 is : 143
2015-11-23 16:39:14,489 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448267918096_0002_01_000003 is : 143
2015-11-23 16:39:14,523 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448267918096_0002_01_000002 is : 143
2015-11-23 16:39:15,725 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow4/_temporary
2015-11-23 16:39:15,729 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-flow]  completed in: 00:16.414, using cpu time: 00:02.850
2015-11-23 16:39:15,729 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] completed flow: first-flow
2015-11-23 16:39:15,729 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] starting flow: second-flow
2015-11-23 16:39:15,729 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow] at least one sink is marked for delete
2015-11-23 16:39:15,730 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow] sink oldest modified date: Thu Jan 01 07:59:59 CST 1970
2015-11-23 16:39:15,735 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow] starting
2015-11-23 16:39:15,735 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow4"]
2015-11-23 16:39:15,735 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow5"]
2015-11-23 16:39:15,735 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow]  parallel execution of steps is enabled: true
2015-11-23 16:39:15,735 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow]  executing total steps: 1
2015-11-23 16:39:15,736 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow]  allocating management threads: 1
2015-11-23 16:39:15,737 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow] starting step: (1/1) ...latform/testCascade/flow5
2015-11-23 16:39:15,882 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow] submitted hadoop job: job_1448267918096_0003
2015-11-23 16:39:15,882 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow] tracking url: http://shihc046-public.cn.ibm.com:37618/proxy/application_1448267918096_0003/
2015-11-23 16:39:29,965 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448267918096_0003_01_000002 is : 143
2015-11-23 16:39:30,033 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448267918096_0003_01_000003 is : 143
2015-11-23 16:39:30,334 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448267918096_0003_01_000006 is : 143
2015-11-23 16:39:30,471 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448267918096_0003_01_000005 is : 143
2015-11-23 16:39:30,562 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448267918096_0003_01_000004 is : 143
2015-11-23 16:39:31,759 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow5/_temporary
2015-11-23 16:39:31,764 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-flow]  completed in: 00:16.020, using cpu time: 00:03.680
2015-11-23 16:39:31,764 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] completed flow: second-flow
2015-11-23 16:39:31,765 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] starting flow: first-mr
2015-11-23 16:39:31,765 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-mr] at least one sink is marked for delete
2015-11-23 16:39:31,765 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-mr] sink oldest modified date: Thu Jan 01 07:59:59 CST 1970
2015-11-23 16:39:31,769 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-mr] starting
2015-11-23 16:39:31,770 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-mr]  source: Hfs["NullScheme"]["hdfs://localhost:41395/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow5"]
2015-11-23 16:39:31,770 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-mr]  sink: Hfs["NullScheme"]["hdfs://localhost:41395/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow1"]
2015-11-23 16:39:31,770 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-mr]  parallel execution of steps is enabled: true
2015-11-23 16:39:31,770 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-mr]  executing total steps: 1
2015-11-23 16:39:31,770 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-mr]  allocating management threads: 1
2015-11-23 16:39:31,772 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-mr] starting step: Hfs["NullScheme"]["hdfs://localhost:41395/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow1"]
2015-11-23 16:39:31,803 WARN  mapreduce.JobResourceUploader (JobResourceUploader.java:uploadFiles(64)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2015-11-23 16:39:31,807 WARN  mapreduce.JobResourceUploader (JobResourceUploader.java:uploadFiles(171)) - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
2015-11-23 16:39:31,897 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-mr] submitted hadoop job: job_1448267918096_0004
2015-11-23 16:39:31,897 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-mr] tracking url: http://shihc046-public.cn.ibm.com:37618/proxy/application_1448267918096_0004/
2015-11-23 16:39:46,444 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448267918096_0004_01_000003 is : 143
2015-11-23 16:39:46,513 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448267918096_0004_01_000002 is : 143
2015-11-23 16:39:46,813 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448267918096_0004_01_000004 is : 143
2015-11-23 16:39:46,910 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448267918096_0004_01_000005 is : 143
2015-11-23 16:39:46,931 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448267918096_0004_01_000007 is : 143
2015-11-23 16:39:47,018 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448267918096_0004_01_000006 is : 143
2015-11-23 16:39:50,996 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448267918096_0004_01_000008 is : 143
2015-11-23 16:39:52,179 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path hdfs://localhost:41395/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow1/_temporary
2015-11-23 16:39:52,184 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [first-mr]  completed in: 00:20.409, using cpu time: 00:03.110
2015-11-23 16:39:52,184 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] completed flow: first-mr
2015-11-23 16:39:52,184 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] starting flow: second-mr
2015-11-23 16:39:52,184 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-mr] at least one sink is marked for delete
2015-11-23 16:39:52,185 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-mr] sink oldest modified date: Thu Jan 01 07:59:59 CST 1970
2015-11-23 16:39:52,189 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-mr] starting
2015-11-23 16:39:52,189 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-mr]  source: Hfs["NullScheme"]["hdfs://localhost:41395/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow1"]
2015-11-23 16:39:52,189 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-mr]  sink: Hfs["NullScheme"]["hdfs://localhost:41395/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow2"]
2015-11-23 16:39:52,189 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-mr]  parallel execution of steps is enabled: true
2015-11-23 16:39:52,189 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-mr]  executing total steps: 1
2015-11-23 16:39:52,189 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-mr]  allocating management threads: 1
2015-11-23 16:39:52,192 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-mr] starting step: Hfs["NullScheme"]["hdfs://localhost:41395/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow2"]
2015-11-23 16:39:52,223 WARN  mapreduce.JobResourceUploader (JobResourceUploader.java:uploadFiles(64)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2015-11-23 16:39:52,226 WARN  mapreduce.JobResourceUploader (JobResourceUploader.java:uploadFiles(171)) - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
2015-11-23 16:39:52,329 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-mr] submitted hadoop job: job_1448267918096_0005
2015-11-23 16:39:52,329 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-mr] tracking url: http://shihc046-public.cn.ibm.com:37618/proxy/application_1448267918096_0005/
2015-11-23 16:40:05,730 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448267918096_0005_01_000004 is : 143
2015-11-23 16:40:05,778 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448267918096_0005_01_000005 is : 143
2015-11-23 16:40:05,806 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448267918096_0005_01_000002 is : 143
2015-11-23 16:40:05,835 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448267918096_0005_01_000003 is : 143
2015-11-23 16:40:10,719 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448267918096_0005_01_000006 is : 143
2015-11-23 16:40:11,887 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path hdfs://localhost:41395/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow2/_temporary
2015-11-23 16:40:11,890 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [second-mr]  completed in: 00:19.694, using cpu time: 00:02.350
2015-11-23 16:40:11,890 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] completed flow: second-mr
2015-11-23 16:40:11,891 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] starting flow: third-mr
2015-11-23 16:40:11,891 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third-mr] at least one sink is marked for delete
2015-11-23 16:40:11,891 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third-mr] sink oldest modified date: Thu Jan 01 07:59:59 CST 1970
2015-11-23 16:40:11,894 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third-mr] starting
2015-11-23 16:40:11,894 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third-mr]  source: Hfs["NullScheme"]["hdfs://localhost:41395/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow2"]
2015-11-23 16:40:11,895 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third-mr]  sink: Hfs["NullScheme"]["hdfs://localhost:41395/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow3"]
2015-11-23 16:40:11,895 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third-mr]  parallel execution of steps is enabled: true
2015-11-23 16:40:11,895 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third-mr]  executing total steps: 1
2015-11-23 16:40:11,895 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third-mr]  allocating management threads: 1
2015-11-23 16:40:11,896 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third-mr] starting step: Hfs["NullScheme"]["hdfs://localhost:41395/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow3"]
2015-11-23 16:40:11,926 WARN  mapreduce.JobResourceUploader (JobResourceUploader.java:uploadFiles(64)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2015-11-23 16:40:11,928 WARN  mapreduce.JobResourceUploader (JobResourceUploader.java:uploadFiles(171)) - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
2015-11-23 16:40:12,017 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third-mr] submitted hadoop job: job_1448267918096_0006
2015-11-23 16:40:12,017 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third-mr] tracking url: http://shihc046-public.cn.ibm.com:37618/proxy/application_1448267918096_0006/
2015-11-23 16:40:24,676 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448267918096_0006_01_000002 is : 143
2015-11-23 16:40:29,900 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448267918096_0006_01_000003 is : 143
2015-11-23 16:40:31,087 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path hdfs://localhost:41395/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/mapreduceflowplatform/testCascade/flow3/_temporary
2015-11-23 16:40:31,091 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [third-mr]  completed in: 00:19.188, using cpu time: 00:01.070
2015-11-23 16:40:31,092 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [first-flow+second-flow...] completed flow: third-mr
2015-11-23 16:40:31,115 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/mapreduceflowplatform/testCascade/flow3
2015-11-23 16:40:31,121 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/mapreduceflowplatform/testCascade/flow2
2015-11-23 16:40:31,127 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/mapreduceflowplatform/testCascade/flow5
2015-11-23 16:40:31,140 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/mapreduceflowplatform/testCascade/flow4
2015-11-23 16:40:31,153 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/mapreduceflowplatform/testCascade/flow1

Standard error

Nov 23, 2015 4:38:38 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class
Nov 23, 2015 4:38:38 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class
Nov 23, 2015 4:38:38 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Nov 23, 2015 4:38:38 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Nov 23, 2015 4:38:38 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Nov 23, 2015 4:38:38 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Nov 23, 2015 4:38:38 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest"
Nov 23, 2015 4:38:38 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Nov 23, 2015 4:38:39 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class
Nov 23, 2015 4:38:39 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class
Nov 23, 2015 4:38:39 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Nov 23, 2015 4:38:39 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Nov 23, 2015 4:38:39 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Nov 23, 2015 4:38:39 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Nov 23, 2015 4:38:40 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Nov 23, 2015 4:38:40 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Nov 23, 2015 4:38:40 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
Nov 23, 2015 4:38:40 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Nov 23, 2015 4:38:40 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
Nov 23, 2015 4:38:40 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Nov 23, 2015 4:38:40 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Nov 23, 2015 4:38:40 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Nov 23, 2015 4:38:40 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Nov 23, 2015 4:38:40 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Nov 23, 2015 4:38:41 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
Nov 23, 2015 4:38:41 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Nov 23, 2015 4:38:41 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
Nov 23, 2015 4:38:41 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Nov 23, 2015 4:38:41 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Nov 23, 2015 4:38:41 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Nov 23, 2015 4:38:41 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Nov 23, 2015 4:38:41 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Nov 23, 2015 4:38:42 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
Nov 23, 2015 4:38:42 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Nov 23, 2015 4:38:42 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
Nov 23, 2015 4:38:42 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Nov 23, 2015 4:38:42 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Nov 23, 2015 4:38:42 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Nov 23, 2015 4:38:42 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Nov 23, 2015 4:38:42 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.