2016-01-15 04:38:40,414 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(195)) - found 1 test platforms from classpath
2016-01-15 04:38:40,437 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(244)) - adding test: cascading.cascade.CascadePlatformTest, with platform: hadoop2-mr1
2016-01-15 04:38:40,461 INFO hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(136)) - using cluster
2016-01-15 04:38:41,469 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
2016-01-15 04:38:42,100 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(125)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2016-01-15 04:38:46,648 WARN containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-15 04:38:46,861 WARN containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-15 04:38:47,047 WARN containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-15 04:38:47,229 WARN containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-15 04:39:04,330 INFO platform.TestPlatform (TestPlatform.java:getGlobalProperties(73)) - platform property overrides:
2016-01-15 04:39:04,430 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 04:39:04,431 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 04:39:04,496 INFO property.AppProps (AppProps.java:getAppID(177)) - using app.id: 56A5D71F0FCB4F2AB09AE2481A369AD4
2016-01-15 04:39:04,612 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.068
2016-01-15 04:39:04,614 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 04:39:04,615 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 04:39:04,738 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 04:39:04,739 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 04:39:04,789 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.042
2016-01-15 04:39:04,791 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 04:39:04,791 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 04:39:04,861 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 04:39:04,862 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 04:39:04,918 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.045
2016-01-15 04:39:04,920 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 04:39:04,921 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 04:39:04,959 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 04:39:04,960 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 04:39:05,005 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.036
2016-01-15 04:39:05,007 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 04:39:05,007 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 04:39:05,038 INFO util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.0.4
2016-01-15 04:39:05,038 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] starting
2016-01-15 04:39:05,044 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] parallel execution of flows is enabled: true
2016-01-15 04:39:05,044 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] executing total flows: 4
2016-01-15 04:39:05,044 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] allocating management threads: 4
2016-01-15 04:39:05,045 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] starting flow: first
2016-01-15 04:39:05,045 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] skipping flow: first
2016-01-15 04:39:05,047 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] starting flow: second
2016-01-15 04:39:05,047 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] skipping flow: second
2016-01-15 04:39:05,048 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] starting flow: third
2016-01-15 04:39:05,049 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] skipping flow: third
2016-01-15 04:39:05,051 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] starting flow: fourth
2016-01-15 04:39:05,051 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] skipping flow: fourth
2016-01-15 04:39:05,058 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/cascadeplatform/testSkippedCascade/skipped/third
2016-01-15 04:39:05,059 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/cascadeplatform/testSkippedCascade/skipped/first
2016-01-15 04:39:05,061 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/cascadeplatform/testSkippedCascade/skipped/fourth
2016-01-15 04:39:05,062 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/cascadeplatform/testSkippedCascade/skipped/second
2016-01-15 04:39:05,084 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 04:39:05,084 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 04:39:05,120 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-first] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.030
2016-01-15 04:39:05,121 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-first] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 04:39:05,122 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-first] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 04:39:05,149 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 04:39:05,150 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 04:39:05,184 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-second] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.030
2016-01-15 04:39:05,185 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-second] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 04:39:05,185 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-second] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 04:39:05,212 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 04:39:05,213 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 04:39:05,251 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [multi-tap] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.033
2016-01-15 04:39:05,252 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [multi-tap] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 04:39:05,252 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [multi-tap] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 04:39:05,270 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [multi-tap+previous-mul...] starting
2016-01-15 04:39:05,271 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [multi-tap+previous-mul...] parallel execution of flows is enabled: true
2016-01-15 04:39:05,271 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [multi-tap+previous-mul...] executing total flows: 3
2016-01-15 04:39:05,272 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [multi-tap+previous-mul...] allocating management threads: 3
2016-01-15 04:39:05,272 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [multi-tap+previous-mul...] starting flow: previous-multi-tap-second
2016-01-15 04:39:05,272 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-second] at least one sink is marked for delete
2016-01-15 04:39:05,272 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [multi-tap+previous-mul...] starting flow: previous-multi-tap-first
2016-01-15 04:39:05,273 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-second] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-01-15 04:39:05,273 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-first] at least one sink is marked for delete
2016-01-15 04:39:05,273 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-first] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-01-15 04:39:05,296 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-second] starting
2016-01-15 04:39:05,297 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-first] starting
2016-01-15 04:39:05,297 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-first] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/ips.20.txt"]
2016-01-15 04:39:05,297 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-second] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/ips.20.txt"]
2016-01-15 04:39:05,297 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-first] sink: Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/cascadeplatform/testMultiTapCascade/multitap/first"]
2016-01-15 04:39:05,298 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-first] parallel execution of steps is enabled: true
2016-01-15 04:39:05,298 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-first] executing total steps: 1
2016-01-15 04:39:05,298 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-first] allocating management threads: 1
2016-01-15 04:39:05,298 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-second] sink: Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/cascadeplatform/testMultiTapCascade/multitap/second"]
2016-01-15 04:39:05,298 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-second] parallel execution of steps is enabled: true
2016-01-15 04:39:05,298 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-second] executing total steps: 1
2016-01-15 04:39:05,299 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-second] allocating management threads: 1
2016-01-15 04:39:05,299 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-first] starting step: (1/1) ...TapCascade/multitap/first
2016-01-15 04:39:05,301 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-second] starting step: (1/1) ...apCascade/multitap/second
2016-01-15 04:39:06,371 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-second] submitted hadoop job: job_1452832738829_0002
2016-01-15 04:39:06,372 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-second] tracking url: http://ip-10-167-78-165:37339/proxy/application_1452832738829_0002/
2016-01-15 04:39:06,371 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-first] submitted hadoop job: job_1452832738829_0001
2016-01-15 04:39:06,372 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-first] tracking url: http://ip-10-167-78-165:37339/proxy/application_1452832738829_0001/
2016-01-15 04:39:24,304 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0002_01_000002 is : 143
2016-01-15 04:39:24,479 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0002_01_000003 is : 143
2016-01-15 04:39:25,064 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0002_01_000004 is : 143
2016-01-15 04:39:25,188 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0002_01_000005 is : 143
2016-01-15 04:39:26,471 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/cascadeplatform/testMultiTapCascade/multitap/second/_temporary
2016-01-15 04:39:26,472 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-second] completed in: 00:21.171, using cpu time: 00:04.390
2016-01-15 04:39:26,473 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [multi-tap+previous-mul...] completed flow: previous-multi-tap-second
2016-01-15 04:39:49,182 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0001_01_000002 is : 143
2016-01-15 04:39:49,698 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0001_01_000005 is : 143
2016-01-15 04:39:49,839 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0001_01_000004 is : 143
2016-01-15 04:39:50,259 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0001_01_000003 is : 143
2016-01-15 04:39:51,466 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/cascadeplatform/testMultiTapCascade/multitap/first/_temporary
2016-01-15 04:39:51,468 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-first] completed in: 00:46.167, using cpu time: 00:04.320
2016-01-15 04:39:51,468 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [multi-tap+previous-mul...] completed flow: previous-multi-tap-first
2016-01-15 04:39:51,468 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [multi-tap+previous-mul...] starting flow: multi-tap
2016-01-15 04:39:51,469 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [multi-tap] at least one sink is marked for delete
2016-01-15 04:39:51,469 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [multi-tap] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-01-15 04:39:51,472 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [multi-tap] starting
2016-01-15 04:39:51,473 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [multi-tap] source: MultiSourceTap[2:[Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/cascadeplatform/testMultiTapCascade/multitap/first"], Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/cascadeplatform/testMultiTapCascade/multitap/second"]]]
2016-01-15 04:39:51,473 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [multi-tap] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/cascadeplatform/testMultiTapCascade/multitap/multitap"]
2016-01-15 04:39:51,473 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [multi-tap] parallel execution of steps is enabled: true
2016-01-15 04:39:51,473 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [multi-tap] executing total steps: 1
2016-01-15 04:39:51,473 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [multi-tap] allocating management threads: 1
2016-01-15 04:39:51,475 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [multi-tap] starting step: (1/1) ...Cascade/multitap/multitap
2016-01-15 04:39:51,624 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [multi-tap] submitted hadoop job: job_1452832738829_0003
2016-01-15 04:39:51,625 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [multi-tap] tracking url: http://ip-10-167-78-165:37339/proxy/application_1452832738829_0003/
2016-01-15 04:40:22,919 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0003_01_000002 is : 143
2016-01-15 04:40:24,276 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0003_01_000007 is : 143
2016-01-15 04:40:24,501 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0003_01_000004 is : 143
2016-01-15 04:40:24,769 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0003_01_000009 is : 143
2016-01-15 04:40:24,809 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0003_01_000005 is : 143
2016-01-15 04:40:25,834 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0003_01_000008 is : 143
2016-01-15 04:40:27,054 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/cascadeplatform/testMultiTapCascade/multitap/multitap/_temporary
2016-01-15 04:40:27,056 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [multi-tap] completed in: 00:35.580, using cpu time: 00:09.170
2016-01-15 04:40:27,056 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [multi-tap+previous-mul...] completed flow: multi-tap
2016-01-15 04:40:27,103 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/cascadeplatform/testMultiTapCascade/multitap/first
2016-01-15 04:40:27,118 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/cascadeplatform/testMultiTapCascade/multitap/multitap
2016-01-15 04:40:27,141 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/cascadeplatform/testMultiTapCascade/multitap/second
2016-01-15 04:40:27,173 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 04:40:27,174 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 04:40:27,202 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.024
2016-01-15 04:40:27,204 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 04:40:27,205 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 04:40:27,242 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 04:40:27,243 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 04:40:27,272 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.023
2016-01-15 04:40:27,273 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 04:40:27,273 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 04:40:27,300 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 04:40:27,300 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 04:40:27,311 INFO planner.FlowPlanner (FlowPlanner.java:makeTempTap(767)) - found checkpoint: checkpoint, using tap: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/cascadeplatform/testCheckpointTapCascade/checkpoint/third"]
2016-01-15 04:40:27,354 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.049
2016-01-15 04:40:27,355 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 2, nodes: 2
2016-01-15 04:40:27,355 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 04:40:27,386 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 04:40:27,386 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 04:40:27,414 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.024
2016-01-15 04:40:27,415 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 04:40:27,415 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 04:40:27,424 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second++first] starting
2016-01-15 04:40:27,425 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second++first] parallel execution of flows is enabled: true
2016-01-15 04:40:27,425 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second++first] executing total flows: 4
2016-01-15 04:40:27,425 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second++first] allocating management threads: 4
2016-01-15 04:40:27,426 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second++first] starting flow: first
2016-01-15 04:40:27,427 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] at least one sink is marked for delete
2016-01-15 04:40:27,427 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-01-15 04:40:27,430 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] starting
2016-01-15 04:40:27,430 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/ips.20.txt"]
2016-01-15 04:40:27,431 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] sink: Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/cascadeplatform/testCheckpointTapCascade/checkpoint/first"]
2016-01-15 04:40:27,431 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] parallel execution of steps is enabled: true
2016-01-15 04:40:27,431 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executing total steps: 1
2016-01-15 04:40:27,431 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] allocating management threads: 1
2016-01-15 04:40:27,432 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] starting step: (1/1) ...pCascade/checkpoint/first
2016-01-15 04:40:27,572 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] submitted hadoop job: job_1452832738829_0004
2016-01-15 04:40:27,572 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] tracking url: http://ip-10-167-78-165:37339/proxy/application_1452832738829_0004/
2016-01-15 04:40:49,672 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0004_01_000002 is : 143
2016-01-15 04:40:49,727 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0004_01_000003 is : 143
2016-01-15 04:40:49,862 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0004_01_000005 is : 143
2016-01-15 04:40:50,768 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0004_01_000004 is : 143
2016-01-15 04:40:51,960 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/cascadeplatform/testCheckpointTapCascade/checkpoint/first/_temporary
2016-01-15 04:40:51,961 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] completed in: 00:24.527, using cpu time: 00:04.560
2016-01-15 04:40:51,962 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second++first] completed flow: first
2016-01-15 04:40:51,962 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second++first] starting flow: second
2016-01-15 04:40:51,962 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] at least one sink is marked for delete
2016-01-15 04:40:51,962 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-01-15 04:40:51,965 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] starting
2016-01-15 04:40:51,965 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] source: Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/cascadeplatform/testCheckpointTapCascade/checkpoint/first"]
2016-01-15 04:40:51,966 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/cascadeplatform/testCheckpointTapCascade/checkpoint/second"]
2016-01-15 04:40:51,966 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] parallel execution of steps is enabled: true
2016-01-15 04:40:51,966 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] executing total steps: 1
2016-01-15 04:40:51,966 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] allocating management threads: 1
2016-01-15 04:40:51,968 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] starting step: (1/1) ...Cascade/checkpoint/second
2016-01-15 04:40:52,114 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] submitted hadoop job: job_1452832738829_0005
2016-01-15 04:40:52,114 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] tracking url: http://ip-10-167-78-165:37339/proxy/application_1452832738829_0005/
2016-01-15 04:41:15,856 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0005_01_000002 is : 143
2016-01-15 04:41:16,403 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0005_01_000005 is : 143
2016-01-15 04:41:16,520 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0005_01_000004 is : 143
2016-01-15 04:41:16,654 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0005_01_000003 is : 143
2016-01-15 04:41:17,021 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0005_01_000006 is : 143
2016-01-15 04:41:18,208 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/cascadeplatform/testCheckpointTapCascade/checkpoint/second/_temporary
2016-01-15 04:41:18,209 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] completed in: 00:26.240, using cpu time: 00:05.340
2016-01-15 04:41:18,209 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second++first] completed flow: second
2016-01-15 04:41:18,210 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second++first] starting flow: null
2016-01-15 04:41:18,210 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] at least one sink is marked for delete
2016-01-15 04:41:18,210 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-01-15 04:41:18,217 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] starting
2016-01-15 04:41:18,217 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/cascadeplatform/testCheckpointTapCascade/checkpoint/second"]
2016-01-15 04:41:18,218 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] sink: Hfs["TextDelimited[['mangled']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/cascadeplatform/testCheckpointTapCascade/unusedpath"]
2016-01-15 04:41:18,218 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] parallel execution of steps is enabled: true
2016-01-15 04:41:18,218 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] executing total steps: 2
2016-01-15 04:41:18,218 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] allocating management threads: 2
2016-01-15 04:41:18,221 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] starting step: (1/2) ...pCascade/checkpoint/third
2016-01-15 04:41:18,396 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] submitted hadoop job: job_1452832738829_0006
2016-01-15 04:41:18,397 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] tracking url: http://ip-10-167-78-165:37339/proxy/application_1452832738829_0006/
2016-01-15 04:41:44,386 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0006_01_000006 is : 143
2016-01-15 04:41:45,404 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0006_01_000004 is : 143
2016-01-15 04:41:45,806 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0006_01_000007 is : 143
2016-01-15 04:41:45,952 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0006_01_000002 is : 143
2016-01-15 04:41:46,995 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0006_01_000003 is : 143
2016-01-15 04:41:48,172 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] starting step: (2/2) ...ointTapCascade/unusedpath
2016-01-15 04:41:48,292 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] submitted hadoop job: job_1452832738829_0007
2016-01-15 04:41:48,293 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] tracking url: http://ip-10-167-78-165:37339/proxy/application_1452832738829_0007/
2016-01-15 04:42:17,199 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0007_01_000002 is : 143
2016-01-15 04:42:18,202 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0007_01_000003 is : 143
2016-01-15 04:42:18,849 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0007_01_000004 is : 143
2016-01-15 04:42:19,797 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0007_01_000005 is : 143
2016-01-15 04:42:21,000 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/cascadeplatform/testCheckpointTapCascade/checkpoint/third/_temporary
2016-01-15 04:42:21,002 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/cascadeplatform/testCheckpointTapCascade/unusedpath/_temporary
2016-01-15 04:42:21,004 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] completed in: 01:02.781, using cpu time: 00:13.860
2016-01-15 04:42:21,004 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second++first] completed flow: null
2016-01-15 04:42:21,004 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second++first] starting flow: fourth
2016-01-15 04:42:21,004 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] at least one sink is marked for delete
2016-01-15 04:42:21,004 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-01-15 04:42:21,007 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] starting
2016-01-15 04:42:21,008 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] source: Hfs["TextDelimited[['mangled']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/cascadeplatform/testCheckpointTapCascade/checkpoint/third"]
2016-01-15 04:42:21,008 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/cascadeplatform/testCheckpointTapCascade/checkpoint/fourth"]
2016-01-15 04:42:21,008 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] parallel execution of steps is enabled: true
2016-01-15 04:42:21,008 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] executing total steps: 1
2016-01-15 04:42:21,008 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] allocating management threads: 1
2016-01-15 04:42:21,010 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] starting step: (1/1) ...Cascade/checkpoint/fourth
2016-01-15 04:42:21,132 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] submitted hadoop job: job_1452832738829_0008
2016-01-15 04:42:21,133 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] tracking url: http://ip-10-167-78-165:37339/proxy/application_1452832738829_0008/
2016-01-15 04:42:48,921 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0008_01_000003 is : 143
2016-01-15 04:42:49,790 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0008_01_000002 is : 143
2016-01-15 04:42:50,188 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0008_01_000008 is : 143
2016-01-15 04:42:50,338 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0008_01_000007 is : 143
2016-01-15 04:42:51,057 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0008_01_000004 is : 143
2016-01-15 04:42:52,266 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/cascadeplatform/testCheckpointTapCascade/checkpoint/fourth/_temporary
2016-01-15 04:42:52,267 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] completed in: 00:31.254, using cpu time: 00:07.350
2016-01-15 04:42:52,267 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second++first] completed flow: fourth
2016-01-15 04:42:52,295 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/cascadeplatform/testCheckpointTapCascade/checkpoint/third
2016-01-15 04:42:52,309 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/cascadeplatform/testCheckpointTapCascade/checkpoint/first
2016-01-15 04:42:52,320 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/cascadeplatform/testCheckpointTapCascade/unusedpath
2016-01-15 04:42:52,337 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/cascadeplatform/testCheckpointTapCascade/checkpoint/second
2016-01-15 04:42:52,351 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/cascadeplatform/testCheckpointTapCascade/checkpoint/fourth
2016-01-15 04:42:52,382 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 04:42:52,382 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 04:42:52,411 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.025
2016-01-15 04:42:52,412 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 04:42:52,413 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 04:42:52,438 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 04:42:52,438 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 04:42:52,465 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.022
2016-01-15 04:42:52,466 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 04:42:52,466 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 04:42:52,487 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 04:42:52,487 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 04:42:52,515 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.024
2016-01-15 04:42:52,516 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 04:42:52,516 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 04:42:52,537 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 04:42:52,537 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 04:42:52,563 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.022
2016-01-15 04:42:52,565 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 04:42:52,566 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 04:42:52,577 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] starting
2016-01-15 04:42:52,578 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] parallel execution of flows is enabled: true
2016-01-15 04:42:52,578 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] executing total flows: 4
2016-01-15 04:42:52,578 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] allocating management threads: 4
2016-01-15 04:42:52,578 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] starting flow: first
2016-01-15 04:42:52,578 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] at least one sink is marked for delete
2016-01-15 04:42:52,579 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-01-15 04:42:52,582 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] starting
2016-01-15 04:42:52,582 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/ips.20.txt"]
2016-01-15 04:42:52,583 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] sink: Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/cascadeplatform/testSimpleCascadeFail/simple/first"]
2016-01-15 04:42:52,583 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] parallel execution of steps is enabled: true
2016-01-15 04:42:52,583 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executing total steps: 1
2016-01-15 04:42:52,583 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] allocating management threads: 1
2016-01-15 04:42:52,584 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] starting step: (1/1) ...eCascadeFail/simple/first
2016-01-15 04:42:52,693 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] submitted hadoop job: job_1452832738829_0009
2016-01-15 04:42:52,693 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] tracking url: http://ip-10-167-78-165:37339/proxy/application_1452832738829_0009/
2016-01-15 04:43:13,909 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0009_01_000002 is : 143
2016-01-15 04:43:14,442 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0009_01_000003 is : 143
2016-01-15 04:43:14,537 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0009_01_000004 is : 143
2016-01-15 04:43:14,565 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0009_01_000005 is : 143
2016-01-15 04:43:25,171 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0009_01_000009 is : 143
2016-01-15 04:43:25,236 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0009_01_000008 is : 143
2016-01-15 04:43:25,361 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0009_01_000006 is : 143
2016-01-15 04:43:25,487 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0009_01_000007 is : 143
2016-01-15 04:43:35,758 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0009_01_000013 is : 143
2016-01-15 04:43:36,156 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0009_01_000012 is : 143
2016-01-15 04:43:36,283 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0009_01_000011 is : 143
2016-01-15 04:43:39,722 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1080)) - Event EventType: KILL_CONTAINER sent to absent container container_1452832738829_0009_01_000018
2016-01-15 04:43:40,114 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1080)) - Event EventType: KILL_CONTAINER sent to absent container container_1452832738829_0009_01_000019
2016-01-15 04:43:40,122 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1080)) - Event EventType: KILL_CONTAINER sent to absent container container_1452832738829_0009_01_000020
2016-01-15 04:43:40,266 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1080)) - Event EventType: KILL_CONTAINER sent to absent container container_1452832738829_0009_01_000021
2016-01-15 04:43:44,936 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0009_01_000014 is : 143
2016-01-15 04:43:45,010 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0009_01_000017 is : 143
2016-01-15 04:43:45,021 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0009_01_000016 is : 143
2016-01-15 04:43:45,056 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0009_01_000015 is : 143
2016-01-15 04:43:46,172 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [first] hadoop job job_1452832738829_0009 state at FAILED
2016-01-15 04:43:46,172 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [first] failure info: Task failed task_1452832738829_0009_m_000001
Job failed as tasks failed. failedMaps:1 failedReduces:0
2016-01-15 04:43:46,198 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [first] task completion events identify failed tasks
2016-01-15 04:43:46,198 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [first] task completion events count: 10
2016-01-15 04:43:46,199 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [first] event = Task Id : attempt_1452832738829_0009_m_000000_0, Status : FAILED
2016-01-15 04:43:46,199 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [first] event = Task Id : attempt_1452832738829_0009_m_000001_0, Status : FAILED
2016-01-15 04:43:46,199 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [first] event = Task Id : attempt_1452832738829_0009_m_000002_0, Status : FAILED
2016-01-15 04:43:46,199 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [first] event = Task Id : attempt_1452832738829_0009_m_000003_0, Status : FAILED
2016-01-15 04:43:46,199 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [first] event = Task Id : attempt_1452832738829_0009_m_000003_1, Status : FAILED
2016-01-15 04:43:46,199 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [first] event = Task Id : attempt_1452832738829_0009_m_000002_1, Status : FAILED
2016-01-15 04:43:46,200 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [first] event = Task Id : attempt_1452832738829_0009_m_000000_1, Status : FAILED
2016-01-15 04:43:46,200 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [first] event = Task Id : attempt_1452832738829_0009_m_000001_1, Status : FAILED
2016-01-15 04:43:46,200 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [first] event = Task Id : attempt_1452832738829_0009_m_000001_2, Status : FAILED
2016-01-15 04:43:46,200 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [first] event = Task Id : attempt_1452832738829_0009_m_000000_2, Status : FAILED
2016-01-15 04:43:46,232 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] stopping all jobs
2016-01-15 04:43:46,233 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] stopping: (1/1) ...eCascadeFail/simple/first
2016-01-15 04:43:46,235 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] stopped all jobs
2016-01-15 04:43:46,237 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/cascadeplatform/testSimpleCascadeFail/simple/first/_temporary
2016-01-15 04:43:46,238 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] completed in: 00:53.653
2016-01-15 04:43:46,239 WARN cascade.Cascade (BaseCascade.java:logWarn(878)) - [fourth+second+third+first] flow failed: first
cascading.flow.FlowException: step failed: (1/1) ...eCascadeFail/simple/first, step id: DA45409B9AA04B3C890EA562580BC3E2, job id: job_1452832738829_0009, please see cluster logs for failure messages
at cascading.flow.planner.FlowStepJob.blockOnJob(FlowStepJob.java:295)
at cascading.flow.planner.FlowStepJob.start(FlowStepJob.java:184)
at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:146)
at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:48)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2016-01-15 04:43:46,242 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] stopping all flows
2016-01-15 04:43:46,242 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] stopping flow: fourth
2016-01-15 04:43:46,244 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] stopping all jobs
2016-01-15 04:43:46,244 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] stopping: (1/1) ...CascadeFail/simple/fourth
2016-01-15 04:43:46,245 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] stopped all jobs
2016-01-15 04:43:46,245 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] stopping flow: third
2016-01-15 04:43:46,245 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] stopping all jobs
2016-01-15 04:43:46,245 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] stopping: (1/1) ...eCascadeFail/simple/third
2016-01-15 04:43:46,246 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] stopped all jobs
2016-01-15 04:43:46,246 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] stopping flow: second
2016-01-15 04:43:46,246 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] stopping all jobs
2016-01-15 04:43:46,247 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] stopping: (1/1) ...CascadeFail/simple/second
2016-01-15 04:43:46,247 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] stopped all jobs
2016-01-15 04:43:46,247 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] stopping flow: first
2016-01-15 04:43:46,247 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] stopping all jobs
2016-01-15 04:43:46,247 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] stopping: (1/1) ...eCascadeFail/simple/first
2016-01-15 04:43:46,248 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] stopped all jobs
2016-01-15 04:43:46,248 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] stopped all flows
2016-01-15 04:43:46,249 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/cascadeplatform/testSimpleCascadeFail/simple/third
2016-01-15 04:43:46,250 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/cascadeplatform/testSimpleCascadeFail/simple/first
2016-01-15 04:43:46,252 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/cascadeplatform/testSimpleCascadeFail/simple/fourth
2016-01-15 04:43:46,253 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/cascadeplatform/testSimpleCascadeFail/simple/second
2016-01-15 04:43:46,268 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 04:43:46,268 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 04:43:46,294 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.022
2016-01-15 04:43:46,295 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 04:43:46,295 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 04:43:46,315 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 04:43:46,315 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 04:43:46,340 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.022
2016-01-15 04:43:46,341 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 04:43:46,341 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 04:43:46,361 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 04:43:46,362 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 04:43:46,387 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.021
2016-01-15 04:43:46,387 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 04:43:46,388 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 04:43:46,407 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 04:43:46,407 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 04:43:46,432 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.022
2016-01-15 04:43:46,433 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 04:43:46,433 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
calling start
2016-01-15 04:43:46,443 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] starting
2016-01-15 04:43:46,444 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] parallel execution of flows is enabled: true
2016-01-15 04:43:46,444 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] executing total flows: 4
2016-01-15 04:43:46,444 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] allocating management threads: 4
2016-01-15 04:43:46,444 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] starting flow: first
2016-01-15 04:43:46,445 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] at least one sink is marked for delete
2016-01-15 04:43:46,445 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
testing if running
2016-01-15 04:43:46,448 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] starting
2016-01-15 04:43:46,449 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/ips.20.txt"]
2016-01-15 04:43:46,449 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] sink: Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/cascadeplatform/testSimpleCascadeStop/stopped/first-nondeterministic"]
2016-01-15 04:43:46,449 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] parallel execution of steps is enabled: true
2016-01-15 04:43:46,450 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executing total steps: 1
2016-01-15 04:43:46,450 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] allocating management threads: 1
2016-01-15 04:43:46,451 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] starting step: (1/1) ...ed/first-nondeterministic
2016-01-15 04:43:46,606 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] submitted hadoop job: job_1452832738829_0010
2016-01-15 04:43:46,607 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] tracking url: http://ip-10-167-78-165:37339/proxy/application_1452832738829_0010/
testing if running
testing if running
testing if running
testing if running
testing if running
testing if running
testing if running
testing if running
testing if running
testing if running
testing if running
testing if running
testing if running
testing if running
testing if running
testing if running
testing if running
testing if running
testing if running
testing if running
testing if running
testing if running
2016-01-15 04:44:08,938 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0010_01_000004 is : 143
2016-01-15 04:44:09,017 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0010_01_000002 is : 143
2016-01-15 04:44:09,089 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0010_01_000005 is : 143
2016-01-15 04:44:09,262 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0010_01_000003 is : 143
calling stop
2016-01-15 04:44:09,493 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] stopping all flows
2016-01-15 04:44:09,494 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] stopping flow: fourth
2016-01-15 04:44:09,494 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] stopping all jobs
2016-01-15 04:44:09,494 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] stopping: (1/1) ...d/fourth-nondeterministic
2016-01-15 04:44:09,494 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] stopped all jobs
2016-01-15 04:44:09,495 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] stopping flow: third
2016-01-15 04:44:09,495 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] stopping all jobs
2016-01-15 04:44:09,495 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] stopping: (1/1) ...ed/third-nondeterministic
2016-01-15 04:44:09,495 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] stopped all jobs
2016-01-15 04:44:09,496 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] stopping flow: second
2016-01-15 04:44:09,496 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] stopping all jobs
2016-01-15 04:44:09,496 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] stopping: (1/1) ...d/second-nondeterministic
2016-01-15 04:44:09,496 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] stopped all jobs
2016-01-15 04:44:09,497 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] stopping flow: first
2016-01-15 04:44:09,497 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] stopping all jobs
2016-01-15 04:44:09,497 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] stopping: (1/1) ...ed/first-nondeterministic
2016-01-15 04:44:10,515 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] stopped all jobs
2016-01-15 04:44:10,515 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] shutting down job executor
2016-01-15 04:44:10,550 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] shutdown complete
2016-01-15 04:44:10,551 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] stopped all flows
2016-01-15 04:44:10,551 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] shutting down flow executor
2016-01-15 04:44:10,551 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] completed in: 00:23.049, using cpu time: 00:04.390
2016-01-15 04:44:10,552 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] completed flow: first
2016-01-15 04:44:10,553 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] shutdown complete
2016-01-15 04:44:10,557 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/cascadeplatform/testSimpleCascadeStop/stopped/third-nondeterministic
2016-01-15 04:44:10,560 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/cascadeplatform/testSimpleCascadeStop/stopped/second-nondeterministic
2016-01-15 04:44:10,562 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/cascadeplatform/testSimpleCascadeStop/stopped/first-nondeterministic
2016-01-15 04:44:10,576 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/cascadeplatform/testSimpleCascadeStop/stopped/fourth-nondeterministic
2016-01-15 04:44:10,599 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 04:44:10,600 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 04:44:10,626 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.022
2016-01-15 04:44:10,628 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 04:44:10,628 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 04:44:10,646 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 04:44:10,646 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 04:44:10,672 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.023
2016-01-15 04:44:10,675 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 04:44:10,675 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 04:44:10,694 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 04:44:10,694 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 04:44:10,720 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.023
2016-01-15 04:44:10,723 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 04:44:10,723 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 04:44:10,744 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 04:44:10,744 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 04:44:10,767 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.020
2016-01-15 04:44:10,768 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 04:44:10,768 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 04:44:10,777 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] starting
2016-01-15 04:44:10,777 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] parallel execution of flows is enabled: true
2016-01-15 04:44:10,777 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] executing total flows: 4
2016-01-15 04:44:10,777 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] allocating management threads: 4
2016-01-15 04:44:10,778 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] starting flow: first
2016-01-15 04:44:10,779 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] at least one sink is marked for delete
2016-01-15 04:44:10,779 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-01-15 04:44:10,783 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] starting
2016-01-15 04:44:10,784 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/ips.20.txt"]
2016-01-15 04:44:10,784 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] sink: Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/cascadeplatform/testSimpleCascade/simple/first"]
2016-01-15 04:44:10,784 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] parallel execution of steps is enabled: true
2016-01-15 04:44:10,784 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executing total steps: 1
2016-01-15 04:44:10,784 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] allocating management threads: 1
2016-01-15 04:44:10,785 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] starting step: (1/1) ...impleCascade/simple/first
2016-01-15 04:44:10,843 WARN blockmanagement.BlockPlacementPolicy (BlockPlacementPolicyDefault.java:chooseTarget(382)) - Failed to place enough replicas, still in need of 1 to reach 4 (unavailableStorages=[], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}, newBlock=true) For more information, please enable DEBUG log level on org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicy
2016-01-15 04:44:10,844 WARN protocol.BlockStoragePolicy (BlockStoragePolicy.java:chooseStorageTypes(160)) - Failed to place enough replicas: expected size is 1 but only 0 storage types can be selected (replication=4, selected=[], unavailable=[DISK], removed=[DISK], policy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]})
2016-01-15 04:44:10,844 WARN blockmanagement.BlockPlacementPolicy (BlockPlacementPolicyDefault.java:chooseTarget(382)) - Failed to place enough replicas, still in need of 1 to reach 4 (unavailableStorages=[DISK], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}, newBlock=true) All required storage types are unavailable: unavailableStorages=[DISK], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}
2016-01-15 04:44:10,892 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] submitted hadoop job: job_1452832738829_0011
2016-01-15 04:44:10,892 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] tracking url: http://ip-10-167-78-165:37339/proxy/application_1452832738829_0011/
2016-01-15 04:44:32,781 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0011_01_000004 is : 143
2016-01-15 04:44:32,922 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0011_01_000005 is : 143
2016-01-15 04:44:33,096 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0011_01_000002 is : 143
2016-01-15 04:44:34,284 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/cascadeplatform/testSimpleCascade/simple/first/_temporary
2016-01-15 04:44:34,286 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] completed in: 00:23.499, using cpu time: 00:04.440
2016-01-15 04:44:34,286 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] completed flow: first
2016-01-15 04:44:34,286 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] starting flow: second
2016-01-15 04:44:34,286 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] at least one sink is marked for delete
2016-01-15 04:44:34,286 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-01-15 04:44:34,290 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] starting
2016-01-15 04:44:34,290 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] source: Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/cascadeplatform/testSimpleCascade/simple/first"]
2016-01-15 04:44:34,290 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/cascadeplatform/testSimpleCascade/simple/second"]
2016-01-15 04:44:34,290 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] parallel execution of steps is enabled: true
2016-01-15 04:44:34,290 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] executing total steps: 1
2016-01-15 04:44:34,290 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] allocating management threads: 1
2016-01-15 04:44:34,291 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] starting step: (1/1) ...mpleCascade/simple/second
2016-01-15 04:44:34,407 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] submitted hadoop job: job_1452832738829_0012
2016-01-15 04:44:34,407 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] tracking url: http://ip-10-167-78-165:37339/proxy/application_1452832738829_0012/
2016-01-15 04:44:58,002 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0012_01_000003 is : 143
2016-01-15 04:44:58,300 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0012_01_000002 is : 143
2016-01-15 04:44:59,120 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0012_01_000004 is : 143
2016-01-15 04:44:59,164 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0012_01_000005 is : 143
2016-01-15 04:44:59,195 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0012_01_000006 is : 143
2016-01-15 04:45:00,362 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/cascadeplatform/testSimpleCascade/simple/second/_temporary
2016-01-15 04:45:00,364 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] completed in: 00:26.071, using cpu time: 00:05.280
2016-01-15 04:45:00,364 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] completed flow: second
2016-01-15 04:45:00,364 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] starting flow: third
2016-01-15 04:45:00,364 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] at least one sink is marked for delete
2016-01-15 04:45:00,364 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-01-15 04:45:00,372 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] starting
2016-01-15 04:45:00,373 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/cascadeplatform/testSimpleCascade/simple/second"]
2016-01-15 04:45:00,373 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] sink: Hfs["TextDelimited[['mangled']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/cascadeplatform/testSimpleCascade/simple/third"]
2016-01-15 04:45:00,373 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] parallel execution of steps is enabled: true
2016-01-15 04:45:00,373 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] executing total steps: 1
2016-01-15 04:45:00,373 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] allocating management threads: 1
2016-01-15 04:45:00,374 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] starting step: (1/1) ...impleCascade/simple/third
2016-01-15 04:45:00,480 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] submitted hadoop job: job_1452832738829_0013
2016-01-15 04:45:00,481 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] tracking url: http://ip-10-167-78-165:37339/proxy/application_1452832738829_0013/
2016-01-15 04:45:27,262 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0013_01_000002 is : 143
2016-01-15 04:45:27,917 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0013_01_000005 is : 143
2016-01-15 04:45:28,098 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0013_01_000007 is : 143
2016-01-15 04:45:28,265 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0013_01_000004 is : 143
2016-01-15 04:45:29,483 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/cascadeplatform/testSimpleCascade/simple/third/_temporary
2016-01-15 04:45:29,484 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] completed in: 00:29.109, using cpu time: 00:06.240
2016-01-15 04:45:29,485 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] completed flow: third
2016-01-15 04:45:29,485 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] starting flow: fourth
2016-01-15 04:45:29,485 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] at least one sink is marked for delete
2016-01-15 04:45:29,485 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-01-15 04:45:29,490 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] starting
2016-01-15 04:45:29,491 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] source: Hfs["TextDelimited[['mangled']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/cascadeplatform/testSimpleCascade/simple/third"]
2016-01-15 04:45:29,491 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/cascadeplatform/testSimpleCascade/simple/fourth"]
2016-01-15 04:45:29,491 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] parallel execution of steps is enabled: true
2016-01-15 04:45:29,492 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] executing total steps: 1
2016-01-15 04:45:29,492 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] allocating management threads: 1
2016-01-15 04:45:29,494 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] starting step: (1/1) ...mpleCascade/simple/fourth
2016-01-15 04:45:29,556 WARN blockmanagement.BlockPlacementPolicy (BlockPlacementPolicyDefault.java:chooseTarget(382)) - Failed to place enough replicas, still in need of 1 to reach 4 (unavailableStorages=[], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}, newBlock=true) For more information, please enable DEBUG log level on org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicy
2016-01-15 04:45:29,556 WARN protocol.BlockStoragePolicy (BlockStoragePolicy.java:chooseStorageTypes(160)) - Failed to place enough replicas: expected size is 1 but only 0 storage types can be selected (replication=4, selected=[], unavailable=[DISK], removed=[DISK], policy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]})
2016-01-15 04:45:29,556 WARN blockmanagement.BlockPlacementPolicy (BlockPlacementPolicyDefault.java:chooseTarget(382)) - Failed to place enough replicas, still in need of 1 to reach 4 (unavailableStorages=[DISK], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}, newBlock=true) All required storage types are unavailable: unavailableStorages=[DISK], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}
2016-01-15 04:45:29,608 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] submitted hadoop job: job_1452832738829_0014
2016-01-15 04:45:29,608 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] tracking url: http://ip-10-167-78-165:37339/proxy/application_1452832738829_0014/
2016-01-15 04:45:57,408 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0014_01_000008 is : 143
2016-01-15 04:45:58,652 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0014_01_000006 is : 143
2016-01-15 04:45:58,967 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0014_01_000007 is : 143
2016-01-15 04:45:59,004 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0014_01_000004 is : 143
2016-01-15 04:45:59,258 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0014_01_000003 is : 143
2016-01-15 04:45:59,332 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452832738829_0014_01_000002 is : 143
2016-01-15 04:46:00,532 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/cascadeplatform/testSimpleCascade/simple/fourth/_temporary
2016-01-15 04:46:00,533 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] completed in: 00:31.040, using cpu time: 00:07.310
2016-01-15 04:46:00,533 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] completed flow: fourth
2016-01-15 04:46:00,560 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/cascadeplatform/testSimpleCascade/simple/first
2016-01-15 04:46:00,573 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/cascadeplatform/testSimpleCascade/simple/third
2016-01-15 04:46:00,589 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/cascadeplatform/testSimpleCascade/simple/second
2016-01-15 04:46:00,603 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/cascadeplatform/testSimpleCascade/simple/fourth
2016-01-15 04:46:00,634 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 04:46:00,634 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 04:46:00,667 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.029
2016-01-15 04:46:00,669 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 04:46:00,670 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 04:46:00,691 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 04:46:00,691 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 04:46:00,715 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.020
2016-01-15 04:46:00,716 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 04:46:00,717 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 04:46:00,736 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 04:46:00,737 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 04:46:00,760 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.020
2016-01-15 04:46:00,761 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 04:46:00,762 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 04:46:00,781 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 04:46:00,781 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 04:46:00,804 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.020
2016-01-15 04:46:00,806 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 04:46:00,806 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 04:46:00,814 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/cascadeplatform/testCascadeID/idtest/second
2016-01-15 04:46:00,815 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/cascadeplatform/testCascadeID/idtest/fourth
2016-01-15 04:46:00,816 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/cascadeplatform/testCascadeID/idtest/first
2016-01-15 04:46:00,817 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/cascadeplatform/testCascadeID/idtest/third
2016-01-15 04:46:00,831 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 04:46:00,832 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 04:46:00,854 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.019
2016-01-15 04:46:00,856 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 04:46:00,856 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 04:46:00,890 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 04:46:00,890 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 04:46:00,920 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.027
2016-01-15 04:46:00,921 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 2, nodes: 2
2016-01-15 04:46:00,921 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'