2016-01-14 18:52:39,307 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(195)) - found 1 test platforms from classpath
2016-01-14 18:52:39,330 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(244)) - adding test: cascading.cascade.CascadePlatformTest, with platform: hadoop2-mr1
2016-01-14 18:52:39,356 INFO hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(136)) - using cluster
2016-01-14 18:52:40,161 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
2016-01-14 18:52:40,698 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2016-01-14 18:52:41,253 WARN server.AuthenticationFilter (AuthenticationFilter.java:init(158)) - 'signature.secret' configuration not set, using a random value as secret
2016-01-14 18:52:44,216 WARN containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-14 18:52:44,356 WARN containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-14 18:52:44,467 WARN containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-14 18:52:44,583 WARN containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-14 18:53:01,659 INFO platform.TestPlatform (TestPlatform.java:getGlobalProperties(73)) - platform property overrides:
2016-01-14 18:53:01,759 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:53:01,760 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 18:53:01,833 INFO property.AppProps (AppProps.java:getAppID(177)) - using app.id: 28B1B561AD2B45DBA74A2B20AD504C29
2016-01-14 18:53:01,941 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.067
2016-01-14 18:53:01,944 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:53:01,946 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:53:02,067 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:53:02,068 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 18:53:02,114 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.039
2016-01-14 18:53:02,116 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:53:02,117 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:53:02,151 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:53:02,152 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 18:53:02,191 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.031
2016-01-14 18:53:02,193 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:53:02,193 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:53:02,231 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:53:02,232 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 18:53:02,275 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.033
2016-01-14 18:53:02,277 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:53:02,277 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:53:02,303 INFO util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.0.4
2016-01-14 18:53:02,304 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] starting
2016-01-14 18:53:02,311 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] parallel execution of flows is enabled: true
2016-01-14 18:53:02,311 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] executing total flows: 4
2016-01-14 18:53:02,311 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] allocating management threads: 4
2016-01-14 18:53:02,312 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] starting flow: first
2016-01-14 18:53:02,314 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] skipping flow: first
2016-01-14 18:53:02,314 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] starting flow: second
2016-01-14 18:53:02,315 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] skipping flow: second
2016-01-14 18:53:02,316 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] starting flow: third
2016-01-14 18:53:02,317 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] skipping flow: third
2016-01-14 18:53:02,317 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] starting flow: fourth
2016-01-14 18:53:02,318 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] skipping flow: fourth
2016-01-14 18:53:02,325 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/cascadeplatform/testSkippedCascade/skipped/third
2016-01-14 18:53:02,326 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/cascadeplatform/testSkippedCascade/skipped/second
2016-01-14 18:53:02,327 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/cascadeplatform/testSkippedCascade/skipped/first
2016-01-14 18:53:02,328 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/cascadeplatform/testSkippedCascade/skipped/fourth
2016-01-14 18:53:02,355 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:53:02,356 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 18:53:02,405 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-first] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.041
2016-01-14 18:53:02,407 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-first] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:53:02,407 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-first] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:53:02,437 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:53:02,438 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 18:53:02,482 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-second] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.036
2016-01-14 18:53:02,483 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-second] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:53:02,484 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-second] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:53:02,506 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:53:02,507 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 18:53:02,544 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [multi-tap] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.032
2016-01-14 18:53:02,545 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [multi-tap] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:53:02,545 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [multi-tap] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:53:02,563 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [multi-tap+previous-mul...] starting
2016-01-14 18:53:02,564 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [multi-tap+previous-mul...] parallel execution of flows is enabled: true
2016-01-14 18:53:02,564 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [multi-tap+previous-mul...] executing total flows: 3
2016-01-14 18:53:02,565 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [multi-tap+previous-mul...] allocating management threads: 3
2016-01-14 18:53:02,566 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [multi-tap+previous-mul...] starting flow: previous-multi-tap-second
2016-01-14 18:53:02,566 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [multi-tap+previous-mul...] starting flow: previous-multi-tap-first
2016-01-14 18:53:02,566 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-second] at least one sink is marked for delete
2016-01-14 18:53:02,566 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-first] at least one sink is marked for delete
2016-01-14 18:53:02,566 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-second] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-01-14 18:53:02,566 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-first] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-01-14 18:53:02,588 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-first] starting
2016-01-14 18:53:02,590 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-second] starting
2016-01-14 18:53:02,590 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-first] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/classes/test/data/ips.20.txt"]
2016-01-14 18:53:02,591 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-first] sink: Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/cascadeplatform/testMultiTapCascade/multitap/first"]
2016-01-14 18:53:02,591 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-first] parallel execution of steps is enabled: true
2016-01-14 18:53:02,591 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-first] executing total steps: 1
2016-01-14 18:53:02,592 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-first] allocating management threads: 1
2016-01-14 18:53:02,590 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-second] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/classes/test/data/ips.20.txt"]
2016-01-14 18:53:02,592 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-second] sink: Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/cascadeplatform/testMultiTapCascade/multitap/second"]
2016-01-14 18:53:02,592 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-second] parallel execution of steps is enabled: true
2016-01-14 18:53:02,593 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-first] starting step: (1/1) ...TapCascade/multitap/first
2016-01-14 18:53:02,594 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-second] executing total steps: 1
2016-01-14 18:53:02,594 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-second] allocating management threads: 1
2016-01-14 18:53:02,596 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-second] starting step: (1/1) ...apCascade/multitap/second
2016-01-14 18:53:03,565 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-second] submitted hadoop job: job_1452797576156_0002
2016-01-14 18:53:03,565 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-second] tracking url: http://ip-10-167-78-165.ec2.internal:54997/proxy/application_1452797576156_0002/
2016-01-14 18:53:03,576 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-first] submitted hadoop job: job_1452797576156_0001
2016-01-14 18:53:03,576 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-first] tracking url: http://ip-10-167-78-165.ec2.internal:54997/proxy/application_1452797576156_0001/
2016-01-14 18:53:32,555 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0001_01_000002 is : 143
2016-01-14 18:53:32,960 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0002_01_000003 is : 143
2016-01-14 18:53:33,086 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0001_01_000004 is : 143
2016-01-14 18:53:33,161 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0002_01_000004 is : 143
2016-01-14 18:53:33,202 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0002_01_000002 is : 143
2016-01-14 18:53:33,574 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0001_01_000005 is : 143
2016-01-14 18:53:34,240 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0002_01_000005 is : 143
2016-01-14 18:53:34,933 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/cascadeplatform/testMultiTapCascade/multitap/first/_temporary
2016-01-14 18:53:34,935 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-first] completed in: 00:32.340, using cpu time: 00:04.420
2016-01-14 18:53:34,935 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [multi-tap+previous-mul...] completed flow: previous-multi-tap-first
2016-01-14 18:53:35,491 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/cascadeplatform/testMultiTapCascade/multitap/second/_temporary
2016-01-14 18:53:35,493 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [previous-multi-tap-second] completed in: 00:32.900, using cpu time: 00:04.350
2016-01-14 18:53:35,493 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [multi-tap+previous-mul...] completed flow: previous-multi-tap-second
2016-01-14 18:53:35,493 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [multi-tap+previous-mul...] starting flow: multi-tap
2016-01-14 18:53:35,493 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [multi-tap] at least one sink is marked for delete
2016-01-14 18:53:35,494 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [multi-tap] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-01-14 18:53:35,497 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [multi-tap] starting
2016-01-14 18:53:35,497 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [multi-tap] source: MultiSourceTap[2:[Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/cascadeplatform/testMultiTapCascade/multitap/first"], Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/cascadeplatform/testMultiTapCascade/multitap/second"]]]
2016-01-14 18:53:35,498 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [multi-tap] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/cascadeplatform/testMultiTapCascade/multitap/multitap"]
2016-01-14 18:53:35,498 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [multi-tap] parallel execution of steps is enabled: true
2016-01-14 18:53:35,498 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [multi-tap] executing total steps: 1
2016-01-14 18:53:35,498 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [multi-tap] allocating management threads: 1
2016-01-14 18:53:35,499 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [multi-tap] starting step: (1/1) ...Cascade/multitap/multitap
2016-01-14 18:53:35,663 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [multi-tap] submitted hadoop job: job_1452797576156_0003
2016-01-14 18:53:35,663 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [multi-tap] tracking url: http://ip-10-167-78-165.ec2.internal:54997/proxy/application_1452797576156_0003/
2016-01-14 18:54:05,009 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0003_01_000005 is : 143
2016-01-14 18:54:05,238 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0003_01_000007 is : 143
2016-01-14 18:54:05,360 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0003_01_000008 is : 143
2016-01-14 18:54:05,398 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0003_01_000006 is : 143
2016-01-14 18:54:05,493 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0003_01_000009 is : 143
2016-01-14 18:54:05,721 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0003_01_000002 is : 143
2016-01-14 18:54:05,995 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0003_01_000003 is : 143
2016-01-14 18:54:06,193 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0003_01_000004 is : 143
2016-01-14 18:54:07,490 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/cascadeplatform/testMultiTapCascade/multitap/multitap/_temporary
2016-01-14 18:54:07,493 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [multi-tap] completed in: 00:31.990, using cpu time: 00:08.790
2016-01-14 18:54:07,493 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [multi-tap+previous-mul...] completed flow: multi-tap
2016-01-14 18:54:07,580 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/cascadeplatform/testMultiTapCascade/multitap/multitap
2016-01-14 18:54:07,603 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/cascadeplatform/testMultiTapCascade/multitap/first
2016-01-14 18:54:07,618 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/cascadeplatform/testMultiTapCascade/multitap/second
2016-01-14 18:54:07,654 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:54:07,655 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 18:54:07,683 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.023
2016-01-14 18:54:07,684 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:54:07,684 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:54:07,716 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:54:07,716 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 18:54:07,747 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.024
2016-01-14 18:54:07,748 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:54:07,748 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:54:07,779 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:54:07,780 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 18:54:07,808 INFO planner.FlowPlanner (FlowPlanner.java:makeTempTap(767)) - found checkpoint: checkpoint, using tap: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/cascadeplatform/testCheckpointTapCascade/checkpoint/third"]
2016-01-14 18:54:07,850 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.053
2016-01-14 18:54:07,851 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 2, nodes: 2
2016-01-14 18:54:07,851 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:54:07,882 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:54:07,882 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 18:54:07,912 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.026
2016-01-14 18:54:07,913 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:54:07,913 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:54:07,923 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second++first] starting
2016-01-14 18:54:07,924 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second++first] parallel execution of flows is enabled: true
2016-01-14 18:54:07,924 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second++first] executing total flows: 4
2016-01-14 18:54:07,924 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second++first] allocating management threads: 4
2016-01-14 18:54:07,925 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second++first] starting flow: first
2016-01-14 18:54:07,925 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] at least one sink is marked for delete
2016-01-14 18:54:07,925 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-01-14 18:54:07,931 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] starting
2016-01-14 18:54:07,932 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/classes/test/data/ips.20.txt"]
2016-01-14 18:54:07,933 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] sink: Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/cascadeplatform/testCheckpointTapCascade/checkpoint/first"]
2016-01-14 18:54:07,933 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] parallel execution of steps is enabled: true
2016-01-14 18:54:07,934 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executing total steps: 1
2016-01-14 18:54:07,935 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] allocating management threads: 1
2016-01-14 18:54:07,936 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] starting step: (1/1) ...pCascade/checkpoint/first
2016-01-14 18:54:08,087 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] submitted hadoop job: job_1452797576156_0004
2016-01-14 18:54:08,087 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] tracking url: http://ip-10-167-78-165.ec2.internal:54997/proxy/application_1452797576156_0004/
2016-01-14 18:54:25,598 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0004_01_000005 is : 143
2016-01-14 18:54:25,635 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0004_01_000004 is : 143
2016-01-14 18:54:25,661 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0004_01_000003 is : 143
2016-01-14 18:54:25,690 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0004_01_000002 is : 143
2016-01-14 18:54:26,984 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/cascadeplatform/testCheckpointTapCascade/checkpoint/first/_temporary
2016-01-14 18:54:26,985 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] completed in: 00:19.050, using cpu time: 00:04.250
2016-01-14 18:54:26,986 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second++first] completed flow: first
2016-01-14 18:54:26,986 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second++first] starting flow: second
2016-01-14 18:54:26,986 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] at least one sink is marked for delete
2016-01-14 18:54:26,987 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-01-14 18:54:26,990 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] starting
2016-01-14 18:54:26,990 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] source: Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/cascadeplatform/testCheckpointTapCascade/checkpoint/first"]
2016-01-14 18:54:26,990 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/cascadeplatform/testCheckpointTapCascade/checkpoint/second"]
2016-01-14 18:54:26,990 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] parallel execution of steps is enabled: true
2016-01-14 18:54:26,991 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] executing total steps: 1
2016-01-14 18:54:26,991 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] allocating management threads: 1
2016-01-14 18:54:26,993 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] starting step: (1/1) ...Cascade/checkpoint/second
2016-01-14 18:54:27,161 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] submitted hadoop job: job_1452797576156_0005
2016-01-14 18:54:27,161 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] tracking url: http://ip-10-167-78-165.ec2.internal:54997/proxy/application_1452797576156_0005/
2016-01-14 18:54:46,400 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0005_01_000003 is : 143
2016-01-14 18:54:46,613 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0005_01_000006 is : 143
2016-01-14 18:54:46,972 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0005_01_000004 is : 143
2016-01-14 18:54:47,213 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0005_01_000002 is : 143
2016-01-14 18:54:47,412 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0005_01_000005 is : 143
2016-01-14 18:54:48,696 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/cascadeplatform/testCheckpointTapCascade/checkpoint/second/_temporary
2016-01-14 18:54:48,698 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] completed in: 00:21.702, using cpu time: 00:05.110
2016-01-14 18:54:48,698 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second++first] completed flow: second
2016-01-14 18:54:48,699 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second++first] starting flow: null
2016-01-14 18:54:48,699 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] at least one sink is marked for delete
2016-01-14 18:54:48,699 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-01-14 18:54:48,704 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] starting
2016-01-14 18:54:48,705 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/cascadeplatform/testCheckpointTapCascade/checkpoint/second"]
2016-01-14 18:54:48,705 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] sink: Hfs["TextDelimited[['mangled']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/cascadeplatform/testCheckpointTapCascade/unusedpath"]
2016-01-14 18:54:48,705 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] parallel execution of steps is enabled: true
2016-01-14 18:54:48,706 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] executing total steps: 2
2016-01-14 18:54:48,706 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] allocating management threads: 2
2016-01-14 18:54:48,708 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] starting step: (1/2) ...pCascade/checkpoint/third
2016-01-14 18:54:48,902 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] submitted hadoop job: job_1452797576156_0006
2016-01-14 18:54:48,902 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] tracking url: http://ip-10-167-78-165.ec2.internal:54997/proxy/application_1452797576156_0006/
2016-01-14 18:55:10,796 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0006_01_000002 is : 143
2016-01-14 18:55:11,270 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0006_01_000006 is : 143
2016-01-14 18:55:11,452 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0006_01_000003 is : 143
2016-01-14 18:55:11,551 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0006_01_000005 is : 143
2016-01-14 18:55:12,788 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] starting step: (2/2) ...ointTapCascade/unusedpath
2016-01-14 18:55:12,943 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] submitted hadoop job: job_1452797576156_0007
2016-01-14 18:55:12,943 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] tracking url: http://ip-10-167-78-165.ec2.internal:54997/proxy/application_1452797576156_0007/
2016-01-14 18:55:35,527 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0007_01_000008 is : 143
2016-01-14 18:55:37,340 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0007_01_000006 is : 143
2016-01-14 18:55:37,410 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0007_01_000003 is : 143
2016-01-14 18:55:37,500 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0007_01_000002 is : 143
2016-01-14 18:55:37,686 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0007_01_000005 is : 143
2016-01-14 18:55:37,730 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0007_01_000004 is : 143
2016-01-14 18:55:39,006 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/cascadeplatform/testCheckpointTapCascade/checkpoint/third/_temporary
2016-01-14 18:55:39,008 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/cascadeplatform/testCheckpointTapCascade/unusedpath/_temporary
2016-01-14 18:55:39,010 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] completed in: 00:50.300, using cpu time: 00:12.870
2016-01-14 18:55:39,010 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second++first] completed flow: null
2016-01-14 18:55:39,010 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second++first] starting flow: fourth
2016-01-14 18:55:39,010 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] at least one sink is marked for delete
2016-01-14 18:55:39,010 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-01-14 18:55:39,013 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] starting
2016-01-14 18:55:39,014 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] source: Hfs["TextDelimited[['mangled']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/cascadeplatform/testCheckpointTapCascade/checkpoint/third"]
2016-01-14 18:55:39,014 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/cascadeplatform/testCheckpointTapCascade/checkpoint/fourth"]
2016-01-14 18:55:39,014 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] parallel execution of steps is enabled: true
2016-01-14 18:55:39,014 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] executing total steps: 1
2016-01-14 18:55:39,014 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] allocating management threads: 1
2016-01-14 18:55:39,015 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] starting step: (1/1) ...Cascade/checkpoint/fourth
2016-01-14 18:55:39,155 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] submitted hadoop job: job_1452797576156_0008
2016-01-14 18:55:39,156 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] tracking url: http://ip-10-167-78-165.ec2.internal:54997/proxy/application_1452797576156_0008/
2016-01-14 18:56:01,811 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0008_01_000002 is : 143
2016-01-14 18:56:03,101 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0008_01_000008 is : 143
2016-01-14 18:56:03,284 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0008_01_000007 is : 143
2016-01-14 18:56:03,449 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0008_01_000006 is : 143
2016-01-14 18:56:03,640 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0008_01_000004 is : 143
2016-01-14 18:56:04,323 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0008_01_000005 is : 143
2016-01-14 18:56:05,604 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/cascadeplatform/testCheckpointTapCascade/checkpoint/fourth/_temporary
2016-01-14 18:56:05,606 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] completed in: 00:26.587, using cpu time: 00:06.790
2016-01-14 18:56:05,606 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second++first] completed flow: fourth
2016-01-14 18:56:05,635 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/cascadeplatform/testCheckpointTapCascade/unusedpath
2016-01-14 18:56:05,651 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/cascadeplatform/testCheckpointTapCascade/checkpoint/first
2016-01-14 18:56:05,662 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/cascadeplatform/testCheckpointTapCascade/checkpoint/second
2016-01-14 18:56:05,682 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/cascadeplatform/testCheckpointTapCascade/checkpoint/fourth
2016-01-14 18:56:05,696 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/cascadeplatform/testCheckpointTapCascade/checkpoint/third
2016-01-14 18:56:05,724 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:56:05,724 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 18:56:05,753 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.025
2016-01-14 18:56:05,754 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:56:05,755 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:56:05,778 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:56:05,779 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 18:56:05,805 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.022
2016-01-14 18:56:05,806 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:56:05,806 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:56:05,825 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:56:05,826 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 18:56:05,857 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.028
2016-01-14 18:56:05,858 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:56:05,858 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:56:05,884 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:56:05,885 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 18:56:05,910 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.021
2016-01-14 18:56:05,911 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:56:05,912 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:56:05,922 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] starting
2016-01-14 18:56:05,923 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] parallel execution of flows is enabled: true
2016-01-14 18:56:05,923 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] executing total flows: 4
2016-01-14 18:56:05,923 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] allocating management threads: 4
2016-01-14 18:56:05,923 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] starting flow: first
2016-01-14 18:56:05,924 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] at least one sink is marked for delete
2016-01-14 18:56:05,924 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-01-14 18:56:05,927 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] starting
2016-01-14 18:56:05,928 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/classes/test/data/ips.20.txt"]
2016-01-14 18:56:05,928 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] sink: Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/cascadeplatform/testSimpleCascadeFail/simple/first"]
2016-01-14 18:56:05,928 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] parallel execution of steps is enabled: true
2016-01-14 18:56:05,928 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executing total steps: 1
2016-01-14 18:56:05,928 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] allocating management threads: 1
2016-01-14 18:56:05,929 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] starting step: (1/1) ...eCascadeFail/simple/first
2016-01-14 18:56:06,079 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] submitted hadoop job: job_1452797576156_0009
2016-01-14 18:56:06,079 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] tracking url: http://ip-10-167-78-165.ec2.internal:54997/proxy/application_1452797576156_0009/
2016-01-14 18:56:22,998 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0009_01_000002 is : 143
2016-01-14 18:56:23,262 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0009_01_000004 is : 143
2016-01-14 18:56:23,325 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0009_01_000005 is : 143
2016-01-14 18:56:23,377 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0009_01_000003 is : 143
2016-01-14 18:56:33,633 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0009_01_000009 is : 143
2016-01-14 18:56:33,776 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0009_01_000007 is : 143
2016-01-14 18:56:34,170 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0009_01_000008 is : 143
2016-01-14 18:56:34,474 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0009_01_000006 is : 143
2016-01-14 18:56:44,556 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0009_01_000011 is : 143
2016-01-14 18:56:44,818 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0009_01_000012 is : 143
2016-01-14 18:56:44,859 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0009_01_000013 is : 143
2016-01-14 18:56:44,941 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0009_01_000010 is : 143
2016-01-14 18:56:48,508 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(831)) - Event EventType: KILL_CONTAINER sent to absent container container_1452797576156_0009_01_000018
2016-01-14 18:56:48,779 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(831)) - Event EventType: KILL_CONTAINER sent to absent container container_1452797576156_0009_01_000019
2016-01-14 18:56:48,830 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(831)) - Event EventType: KILL_CONTAINER sent to absent container container_1452797576156_0009_01_000020
2016-01-14 18:56:48,929 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(831)) - Event EventType: KILL_CONTAINER sent to absent container container_1452797576156_0009_01_000021
2016-01-14 18:56:53,799 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0009_01_000014 is : 143
2016-01-14 18:56:53,845 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0009_01_000015 is : 143
2016-01-14 18:56:53,888 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0009_01_000016 is : 143
2016-01-14 18:56:53,902 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0009_01_000017 is : 143
2016-01-14 18:56:55,051 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [first] hadoop job job_1452797576156_0009 state at FAILED
2016-01-14 18:56:55,052 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [first] failure info: Task failed task_1452797576156_0009_m_000002
Job failed as tasks failed. failedMaps:1 failedReduces:0
2016-01-14 18:56:55,088 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [first] task completion events identify failed tasks
2016-01-14 18:56:55,088 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [first] task completion events count: 10
2016-01-14 18:56:55,089 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [first] event = Task Id : attempt_1452797576156_0009_m_000000_0, Status : FAILED
2016-01-14 18:56:55,089 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [first] event = Task Id : attempt_1452797576156_0009_m_000002_0, Status : FAILED
2016-01-14 18:56:55,089 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [first] event = Task Id : attempt_1452797576156_0009_m_000003_0, Status : FAILED
2016-01-14 18:56:55,089 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [first] event = Task Id : attempt_1452797576156_0009_m_000001_0, Status : FAILED
2016-01-14 18:56:55,089 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [first] event = Task Id : attempt_1452797576156_0009_m_000001_1, Status : FAILED
2016-01-14 18:56:55,089 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [first] event = Task Id : attempt_1452797576156_0009_m_000002_1, Status : FAILED
2016-01-14 18:56:55,090 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [first] event = Task Id : attempt_1452797576156_0009_m_000003_1, Status : FAILED
2016-01-14 18:56:55,090 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [first] event = Task Id : attempt_1452797576156_0009_m_000000_1, Status : FAILED
2016-01-14 18:56:55,090 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [first] event = Task Id : attempt_1452797576156_0009_m_000002_2, Status : FAILED
2016-01-14 18:56:55,090 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [first] event = Task Id : attempt_1452797576156_0009_m_000003_2, Status : FAILED
2016-01-14 18:56:55,118 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] stopping all jobs
2016-01-14 18:56:55,119 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] stopping: (1/1) ...eCascadeFail/simple/first
2016-01-14 18:56:55,123 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] stopped all jobs
2016-01-14 18:56:55,125 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/cascadeplatform/testSimpleCascadeFail/simple/first/_temporary
2016-01-14 18:56:55,126 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] completed in: 00:49.196
2016-01-14 18:56:55,127 WARN cascade.Cascade (BaseCascade.java:logWarn(878)) - [fourth+second+third+first] flow failed: first
cascading.flow.FlowException: step failed: (1/1) ...eCascadeFail/simple/first, step id: D0195C5925CC4994A436E62AE84CEC70, job id: job_1452797576156_0009, please see cluster logs for failure messages
at cascading.flow.planner.FlowStepJob.blockOnJob(FlowStepJob.java:295)
at cascading.flow.planner.FlowStepJob.start(FlowStepJob.java:184)
at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:146)
at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:48)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2016-01-14 18:56:55,130 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] stopping all flows
2016-01-14 18:56:55,130 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] stopping flow: fourth
2016-01-14 18:56:55,131 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] stopping all jobs
2016-01-14 18:56:55,131 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] stopping: (1/1) ...CascadeFail/simple/fourth
2016-01-14 18:56:55,132 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] stopped all jobs
2016-01-14 18:56:55,132 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] stopping flow: third
2016-01-14 18:56:55,132 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] stopping all jobs
2016-01-14 18:56:55,132 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] stopping: (1/1) ...eCascadeFail/simple/third
2016-01-14 18:56:55,133 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] stopped all jobs
2016-01-14 18:56:55,133 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] stopping flow: second
2016-01-14 18:56:55,133 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] stopping all jobs
2016-01-14 18:56:55,133 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] stopping: (1/1) ...CascadeFail/simple/second
2016-01-14 18:56:55,134 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] stopped all jobs
2016-01-14 18:56:55,134 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] stopping flow: first
2016-01-14 18:56:55,134 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] stopping all jobs
2016-01-14 18:56:55,134 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] stopping: (1/1) ...eCascadeFail/simple/first
2016-01-14 18:56:55,135 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] stopped all jobs
2016-01-14 18:56:55,135 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] stopped all flows
2016-01-14 18:56:55,135 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/cascadeplatform/testSimpleCascadeFail/simple/first
2016-01-14 18:56:55,138 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/cascadeplatform/testSimpleCascadeFail/simple/third
2016-01-14 18:56:55,138 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/cascadeplatform/testSimpleCascadeFail/simple/second
2016-01-14 18:56:55,139 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/cascadeplatform/testSimpleCascadeFail/simple/fourth
2016-01-14 18:56:55,152 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:56:55,152 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 18:56:55,197 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.042
2016-01-14 18:56:55,199 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:56:55,199 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:56:55,217 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:56:55,217 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 18:56:55,249 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.029
2016-01-14 18:56:55,250 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:56:55,250 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:56:55,269 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:56:55,270 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 18:56:55,304 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.030
2016-01-14 18:56:55,306 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:56:55,306 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:56:55,326 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:56:55,327 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 18:56:55,360 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.029
2016-01-14 18:56:55,360 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:56:55,361 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
calling start
2016-01-14 18:56:55,371 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] starting
2016-01-14 18:56:55,372 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] parallel execution of flows is enabled: true
2016-01-14 18:56:55,372 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] executing total flows: 4
2016-01-14 18:56:55,372 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] allocating management threads: 4
2016-01-14 18:56:55,373 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] starting flow: first
2016-01-14 18:56:55,373 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] at least one sink is marked for delete
2016-01-14 18:56:55,374 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
testing if running
2016-01-14 18:56:55,377 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] starting
2016-01-14 18:56:55,377 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/classes/test/data/ips.20.txt"]
2016-01-14 18:56:55,378 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] sink: Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/cascadeplatform/testSimpleCascadeStop/stopped/first-nondeterministic"]
2016-01-14 18:56:55,378 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] parallel execution of steps is enabled: true
2016-01-14 18:56:55,378 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executing total steps: 1
2016-01-14 18:56:55,379 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] allocating management threads: 1
2016-01-14 18:56:55,379 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] starting step: (1/1) ...ed/first-nondeterministic
2016-01-14 18:56:55,535 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] submitted hadoop job: job_1452797576156_0010
2016-01-14 18:56:55,535 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] tracking url: http://ip-10-167-78-165.ec2.internal:54997/proxy/application_1452797576156_0010/
testing if running
testing if running
testing if running
testing if running
testing if running
testing if running
testing if running
testing if running
testing if running
testing if running
testing if running
testing if running
testing if running
testing if running
testing if running
testing if running
2016-01-14 18:57:12,255 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0010_01_000003 is : 143
2016-01-14 18:57:12,458 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0010_01_000002 is : 143
calling stop
2016-01-14 18:57:12,553 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] stopping all flows
2016-01-14 18:57:12,554 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] stopping flow: fourth
2016-01-14 18:57:12,554 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] stopping all jobs
2016-01-14 18:57:12,555 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] stopping: (1/1) ...d/fourth-nondeterministic
2016-01-14 18:57:12,555 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] stopped all jobs
2016-01-14 18:57:12,555 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] stopping flow: third
2016-01-14 18:57:12,555 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] stopping all jobs
2016-01-14 18:57:12,556 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] stopping: (1/1) ...ed/third-nondeterministic
2016-01-14 18:57:12,556 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] stopped all jobs
2016-01-14 18:57:12,556 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] stopping flow: second
2016-01-14 18:57:12,556 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] stopping all jobs
2016-01-14 18:57:12,556 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] stopping: (1/1) ...d/second-nondeterministic
2016-01-14 18:57:12,557 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] stopped all jobs
2016-01-14 18:57:12,557 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] stopping flow: first
2016-01-14 18:57:12,557 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] stopping all jobs
2016-01-14 18:57:12,563 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] stopping: (1/1) ...ed/first-nondeterministic
2016-01-14 18:57:12,611 WARN security.UserGroupInformation (UserGroupInformation.java:doAs(1551)) - PriviledgedActionException as:teamcity (auth:SIMPLE) cause:org.apache.hadoop.hdfs.server.namenode.LeaseExpiredException: No lease on /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/cascadeplatform/testSimpleCascadeStop/stopped/first-nondeterministic/_temporary/1/_temporary/attempt_1452797576156_0010_m_000002_0/part-00002: File does not exist. Holder DFSClient_attempt_1452797576156_0010_m_000002_0_1527858499_1 does not have any open files.
2016-01-14 18:57:12,652 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0010_01_000005 is : 143
2016-01-14 18:57:12,687 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0010_01_000004 is : 143
2016-01-14 18:57:14,600 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] stopped all jobs
2016-01-14 18:57:14,600 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] shutting down job executor
2016-01-14 18:57:14,640 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] shutdown complete
2016-01-14 18:57:14,641 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] completed in: 00:17.180, using cpu time: 00:02.050
2016-01-14 18:57:14,641 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] stopped all flows
2016-01-14 18:57:14,641 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] completed flow: first
2016-01-14 18:57:14,642 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] shutting down flow executor
2016-01-14 18:57:14,642 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [first+second+third+fourth] shutdown complete
2016-01-14 18:57:14,642 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/cascadeplatform/testSimpleCascadeStop/stopped/third-nondeterministic
2016-01-14 18:57:14,646 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/cascadeplatform/testSimpleCascadeStop/stopped/fourth-nondeterministic
2016-01-14 18:57:14,646 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/cascadeplatform/testSimpleCascadeStop/stopped/second-nondeterministic
2016-01-14 18:57:14,648 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/cascadeplatform/testSimpleCascadeStop/stopped/first-nondeterministic
2016-01-14 18:57:14,670 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:57:14,671 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 18:57:14,704 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.028
2016-01-14 18:57:14,705 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:57:14,705 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:57:14,732 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:57:14,733 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 18:57:14,783 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.047
2016-01-14 18:57:14,787 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:57:14,787 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:57:14,815 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:57:14,815 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 18:57:14,844 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.025
2016-01-14 18:57:14,845 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:57:14,845 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:57:14,873 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:57:14,874 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 18:57:14,898 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.021
2016-01-14 18:57:14,900 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:57:14,900 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:57:14,910 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] starting
2016-01-14 18:57:14,912 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] parallel execution of flows is enabled: true
2016-01-14 18:57:14,912 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] executing total flows: 4
2016-01-14 18:57:14,912 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] allocating management threads: 4
2016-01-14 18:57:14,913 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] starting flow: first
2016-01-14 18:57:14,913 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] at least one sink is marked for delete
2016-01-14 18:57:14,913 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-01-14 18:57:14,916 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] starting
2016-01-14 18:57:14,917 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/classes/test/data/ips.20.txt"]
2016-01-14 18:57:14,917 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] sink: Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/cascadeplatform/testSimpleCascade/simple/first"]
2016-01-14 18:57:14,917 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] parallel execution of steps is enabled: true
2016-01-14 18:57:14,917 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executing total steps: 1
2016-01-14 18:57:14,918 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] allocating management threads: 1
2016-01-14 18:57:14,919 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] starting step: (1/1) ...impleCascade/simple/first
2016-01-14 18:57:15,082 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] submitted hadoop job: job_1452797576156_0011
2016-01-14 18:57:15,082 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] tracking url: http://ip-10-167-78-165.ec2.internal:54997/proxy/application_1452797576156_0011/
2016-01-14 18:57:31,936 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0011_01_000003 is : 143
2016-01-14 18:57:32,167 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0011_01_000002 is : 143
2016-01-14 18:57:32,502 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0011_01_000005 is : 143
2016-01-14 18:57:32,696 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0011_01_000004 is : 143
2016-01-14 18:57:33,959 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/cascadeplatform/testSimpleCascade/simple/first/_temporary
2016-01-14 18:57:33,960 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] completed in: 00:19.041, using cpu time: 00:04.280
2016-01-14 18:57:33,961 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] completed flow: first
2016-01-14 18:57:33,961 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] starting flow: second
2016-01-14 18:57:33,961 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] at least one sink is marked for delete
2016-01-14 18:57:33,961 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-01-14 18:57:33,964 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] starting
2016-01-14 18:57:33,964 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] source: Hfs["TextDelimited[['ip']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/cascadeplatform/testSimpleCascade/simple/first"]
2016-01-14 18:57:33,965 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/cascadeplatform/testSimpleCascade/simple/second"]
2016-01-14 18:57:33,965 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] parallel execution of steps is enabled: true
2016-01-14 18:57:33,965 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] executing total steps: 1
2016-01-14 18:57:33,965 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] allocating management threads: 1
2016-01-14 18:57:33,968 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] starting step: (1/1) ...mpleCascade/simple/second
2016-01-14 18:57:34,103 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] submitted hadoop job: job_1452797576156_0012
2016-01-14 18:57:34,103 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] tracking url: http://ip-10-167-78-165.ec2.internal:54997/proxy/application_1452797576156_0012/
2016-01-14 18:57:52,331 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0012_01_000002 is : 143
2016-01-14 18:57:52,574 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0012_01_000003 is : 143
2016-01-14 18:57:53,022 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0012_01_000006 is : 143
2016-01-14 18:57:53,566 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0012_01_000004 is : 143
2016-01-14 18:57:53,618 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0012_01_000005 is : 143
2016-01-14 18:57:54,867 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/cascadeplatform/testSimpleCascade/simple/second/_temporary
2016-01-14 18:57:54,869 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] completed in: 00:20.901, using cpu time: 00:05.010
2016-01-14 18:57:54,869 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] completed flow: second
2016-01-14 18:57:54,869 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] starting flow: third
2016-01-14 18:57:54,869 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] at least one sink is marked for delete
2016-01-14 18:57:54,870 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-01-14 18:57:54,872 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] starting
2016-01-14 18:57:54,873 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/cascadeplatform/testSimpleCascade/simple/second"]
2016-01-14 18:57:54,873 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] sink: Hfs["TextDelimited[['mangled']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/cascadeplatform/testSimpleCascade/simple/third"]
2016-01-14 18:57:54,873 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] parallel execution of steps is enabled: true
2016-01-14 18:57:54,873 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] executing total steps: 1
2016-01-14 18:57:54,873 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] allocating management threads: 1
2016-01-14 18:57:54,874 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] starting step: (1/1) ...impleCascade/simple/third
2016-01-14 18:57:55,024 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] submitted hadoop job: job_1452797576156_0013
2016-01-14 18:57:55,025 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] tracking url: http://ip-10-167-78-165.ec2.internal:54997/proxy/application_1452797576156_0013/
2016-01-14 18:58:15,286 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0013_01_000002 is : 143
2016-01-14 18:58:16,294 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0013_01_000003 is : 143
2016-01-14 18:58:16,818 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0013_01_000004 is : 143
2016-01-14 18:58:16,983 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0013_01_000007 is : 143
2016-01-14 18:58:17,087 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0013_01_000005 is : 143
2016-01-14 18:58:17,131 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0013_01_000006 is : 143
2016-01-14 18:58:18,420 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/cascadeplatform/testSimpleCascade/simple/third/_temporary
2016-01-14 18:58:18,421 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] completed in: 00:23.546, using cpu time: 00:05.900
2016-01-14 18:58:18,422 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] completed flow: third
2016-01-14 18:58:18,422 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] starting flow: fourth
2016-01-14 18:58:18,422 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] at least one sink is marked for delete
2016-01-14 18:58:18,422 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-01-14 18:58:18,428 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] starting
2016-01-14 18:58:18,428 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] source: Hfs["TextDelimited[['mangled']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/cascadeplatform/testSimpleCascade/simple/third"]
2016-01-14 18:58:18,428 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/cascadeplatform/testSimpleCascade/simple/fourth"]
2016-01-14 18:58:18,428 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] parallel execution of steps is enabled: true
2016-01-14 18:58:18,428 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] executing total steps: 1
2016-01-14 18:58:18,428 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] allocating management threads: 1
2016-01-14 18:58:18,429 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] starting step: (1/1) ...mpleCascade/simple/fourth
2016-01-14 18:58:18,581 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] submitted hadoop job: job_1452797576156_0014
2016-01-14 18:58:18,581 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] tracking url: http://ip-10-167-78-165.ec2.internal:54997/proxy/application_1452797576156_0014/
2016-01-14 18:58:40,849 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0014_01_000008 is : 143
2016-01-14 18:58:42,971 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0014_01_000004 is : 143
2016-01-14 18:58:43,104 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0014_01_000005 is : 143
2016-01-14 18:58:43,179 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0014_01_000003 is : 143
2016-01-14 18:58:43,252 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0014_01_000007 is : 143
2016-01-14 18:58:44,144 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0014_01_000006 is : 143
2016-01-14 18:58:44,310 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452797576156_0014_01_000002 is : 143
2016-01-14 18:58:45,626 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/cascadeplatform/testSimpleCascade/simple/fourth/_temporary
2016-01-14 18:58:45,628 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] completed in: 00:27.197, using cpu time: 00:06.940
2016-01-14 18:58:45,628 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [fourth+second+third+first] completed flow: fourth
2016-01-14 18:58:45,653 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/cascadeplatform/testSimpleCascade/simple/first
2016-01-14 18:58:45,664 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/cascadeplatform/testSimpleCascade/simple/second
2016-01-14 18:58:45,676 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/cascadeplatform/testSimpleCascade/simple/fourth
2016-01-14 18:58:45,691 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/cascadeplatform/testSimpleCascade/simple/third
2016-01-14 18:58:45,716 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:58:45,716 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 18:58:45,739 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.020
2016-01-14 18:58:45,739 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:58:45,739 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [first] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:58:45,757 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:58:45,757 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 18:58:45,780 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.020
2016-01-14 18:58:45,780 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:58:45,781 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [second] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:58:45,798 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:58:45,798 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 18:58:45,827 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.026
2016-01-14 18:58:45,828 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:58:45,828 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [third] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:58:45,845 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:58:45,846 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 18:58:45,874 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.026
2016-01-14 18:58:45,875 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:58:45,875 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [fourth] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:58:45,883 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/cascadeplatform/testCascadeID/idtest/second
2016-01-14 18:58:45,884 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/cascadeplatform/testCascadeID/idtest/fourth
2016-01-14 18:58:45,884 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/cascadeplatform/testCascadeID/idtest/third
2016-01-14 18:58:45,885 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/cascadeplatform/testCascadeID/idtest/first
2016-01-14 18:58:45,910 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:58:45,911 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 18:58:45,936 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.022
2016-01-14 18:58:45,937 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 18:58:45,937 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 18:58:45,971 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 18:58:45,971 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 18:58:46,008 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.034
2016-01-14 18:58:46,009 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 2, nodes: 2
2016-01-14 18:58:46,009 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'