2016-01-14 19:17:34,865 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(195)) - found 1 test platforms from classpath
2016-01-14 19:17:34,894 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(244)) - adding test: cascading.pipe.checkpoint.CheckpointPlatformTest, with platform: hadoop2-mr1
2016-01-14 19:17:34,930 INFO hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(136)) - using cluster
2016-01-14 19:17:35,793 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
2016-01-14 19:17:36,303 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2016-01-14 19:17:36,885 WARN server.AuthenticationFilter (AuthenticationFilter.java:init(158)) - 'signature.secret' configuration not set, using a random value as secret
2016-01-14 19:17:39,850 WARN containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-14 19:17:39,996 WARN containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-14 19:17:40,109 WARN containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-14 19:17:40,224 WARN containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-14 19:17:57,298 INFO platform.TestPlatform (TestPlatform.java:getGlobalProperties(73)) - platform property overrides:
2016-01-14 19:17:57,401 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 19:17:57,403 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 19:17:57,471 INFO property.AppProps (AppProps.java:getAppID(177)) - using app.id: BCC8335A9F2244C198EF6C4AE8AE2A51
2016-01-14 19:17:57,545 INFO planner.FlowPlanner (FlowPlanner.java:decorateTap(797)) - found decorator: cascading.flowconnector.checkpoint_tap.decorator.classname, wrapping tap: TempHfs["null"][5388362122/test/]
2016-01-14 19:17:57,653 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.145
2016-01-14 19:17:57,658 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 3, nodes: 4
2016-01-14 19:17:57,659 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 19:17:57,826 INFO util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.0.4
2016-01-14 19:17:57,827 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] starting
2016-01-14 19:17:57,828 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/classes/test/data/apache.10.txt"]
2016-01-14 19:17:57,828 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/checkpointplatform/testManyCheckpoints/manycheckpoint"]
2016-01-14 19:17:57,830 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] parallel execution of steps is enabled: true
2016-01-14 19:17:57,830 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] executing total steps: 3
2016-01-14 19:17:57,830 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] allocating management threads: 3
2016-01-14 19:17:57,834 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] starting step: (1/3)
2016-01-14 19:17:58,439 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] submitted hadoop job: job_1452799071795_0001
2016-01-14 19:17:58,439 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] tracking url: http://ip-10-167-78-165.ec2.internal:48225/proxy/application_1452799071795_0001/
2016-01-14 19:18:14,024 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0001_01_000002 is : 143
2016-01-14 19:18:14,833 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0001_01_000003 is : 143
2016-01-14 19:18:15,095 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0001_01_000005 is : 143
2016-01-14 19:18:15,148 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0001_01_000004 is : 143
2016-01-14 19:18:16,376 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] starting step: (2/3)
2016-01-14 19:18:16,653 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] submitted hadoop job: job_1452799071795_0002
2016-01-14 19:18:16,653 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] tracking url: http://ip-10-167-78-165.ec2.internal:48225/proxy/application_1452799071795_0002/
2016-01-14 19:18:32,033 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0002_01_000003 is : 143
2016-01-14 19:18:32,282 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0002_01_000002 is : 143
2016-01-14 19:18:32,446 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0002_01_000004 is : 143
2016-01-14 19:18:32,845 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0002_01_000005 is : 143
2016-01-14 19:18:38,703 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0002_01_000006 is : 143
2016-01-14 19:18:39,875 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] starting step: (3/3) ...heckpoints/manycheckpoint
2016-01-14 19:18:40,097 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] submitted hadoop job: job_1452799071795_0003
2016-01-14 19:18:40,097 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] tracking url: http://ip-10-167-78-165.ec2.internal:48225/proxy/application_1452799071795_0003/
2016-01-14 19:18:50,695 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0003_01_000002 is : 143
2016-01-14 19:18:51,960 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/checkpointplatform/testManyCheckpoints/manycheckpoint/_temporary
2016-01-14 19:18:51,963 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] completed in: 00:54.123, using cpu time: 00:10.160
2016-01-14 19:18:51,999 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/checkpointplatform/testManyCheckpoints/manycheckpoint
2016-01-14 19:18:52,026 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 19:18:52,027 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 19:18:52,097 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.064
2016-01-14 19:18:52,100 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 2, nodes: 3
2016-01-14 19:18:52,100 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 19:18:52,131 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] starting
2016-01-14 19:18:52,132 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/classes/test/data/apache.10.txt"]
2016-01-14 19:18:52,132 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/checkpointplatform/testRestartCheckpoint/restartcheckpoint"]
2016-01-14 19:18:52,133 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] parallel execution of steps is enabled: true
2016-01-14 19:18:52,133 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] executing total steps: 2
2016-01-14 19:18:52,133 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] allocating management threads: 2
2016-01-14 19:18:52,139 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] at least one sink does not exist
2016-01-14 19:18:52,142 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] source modification date at: Thu Jan 14 19:17:57 UTC 2016
2016-01-14 19:18:52,143 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] starting step: (1/2)
2016-01-14 19:18:52,295 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] submitted hadoop job: job_1452799071795_0004
2016-01-14 19:18:52,295 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] tracking url: http://ip-10-167-78-165.ec2.internal:48225/proxy/application_1452799071795_0004/
2016-01-14 19:19:08,166 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0004_01_000003 is : 143
2016-01-14 19:19:08,239 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0004_01_000002 is : 143
2016-01-14 19:19:08,344 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0004_01_000004 is : 143
2016-01-14 19:19:08,519 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0004_01_000005 is : 143
2016-01-14 19:19:09,723 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] starting step: (2/2) ...ckpoint/restartcheckpoint
2016-01-14 19:19:09,899 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] submitted hadoop job: job_1452799071795_0005
2016-01-14 19:19:09,899 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] tracking url: http://ip-10-167-78-165.ec2.internal:48225/proxy/application_1452799071795_0005/
2016-01-14 19:19:25,540 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0005_01_000005 is : 143
2016-01-14 19:19:25,695 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0005_01_000003 is : 143
2016-01-14 19:19:25,743 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0005_01_000004 is : 143
2016-01-14 19:19:25,921 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0005_01_000002 is : 143
2016-01-14 19:19:32,152 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0005_01_000006 is : 143
2016-01-14 19:19:38,118 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0005_01_000007 is : 143
2016-01-14 19:19:44,094 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0005_01_000008 is : 143
2016-01-14 19:19:50,379 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0005_01_000009 is : 143
2016-01-14 19:19:51,515 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [restartable] hadoop job job_1452799071795_0005 state at FAILED
2016-01-14 19:19:51,515 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [restartable] failure info: Task failed task_1452799071795_0005_r_000000
Job failed as tasks failed. failedMaps:0 failedReduces:1
2016-01-14 19:19:51,541 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [restartable] task completion events identify failed tasks
2016-01-14 19:19:51,541 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [restartable] task completion events count: 8
2016-01-14 19:19:51,542 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [restartable] event = Task Id : attempt_1452799071795_0005_m_000003_0, Status : SUCCEEDED
2016-01-14 19:19:51,542 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [restartable] event = Task Id : attempt_1452799071795_0005_m_000001_0, Status : SUCCEEDED
2016-01-14 19:19:51,542 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [restartable] event = Task Id : attempt_1452799071795_0005_m_000002_0, Status : SUCCEEDED
2016-01-14 19:19:51,542 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [restartable] event = Task Id : attempt_1452799071795_0005_m_000000_0, Status : SUCCEEDED
2016-01-14 19:19:51,542 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [restartable] event = Task Id : attempt_1452799071795_0005_r_000000_0, Status : FAILED
2016-01-14 19:19:51,543 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [restartable] event = Task Id : attempt_1452799071795_0005_r_000000_1, Status : FAILED
2016-01-14 19:19:51,543 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [restartable] event = Task Id : attempt_1452799071795_0005_r_000000_2, Status : FAILED
2016-01-14 19:19:51,543 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [restartable] event = Task Id : attempt_1452799071795_0005_r_000000_3, Status : TIPFAILED
2016-01-14 19:19:51,575 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] stopping all jobs
2016-01-14 19:19:51,576 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] stopping: (2/2) ...ckpoint/restartcheckpoint
2016-01-14 19:19:51,579 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] stopping: (1/2)
2016-01-14 19:19:55,068 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] stopped all jobs
2016-01-14 19:19:55,070 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /tmp/hadoop-teamcity/restartable/restartable/test/_temporary
2016-01-14 19:19:55,072 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/checkpointplatform/testRestartCheckpoint/restartcheckpoint/_temporary
2016-01-14 19:19:55,074 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] completed in: 01:02.937, using cpu time: 00:08.100
2016-01-14 19:19:55,092 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 19:19:55,092 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 19:19:55,165 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.067
2016-01-14 19:19:55,168 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 2, nodes: 3
2016-01-14 19:19:55,168 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 19:19:55,199 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] starting
2016-01-14 19:19:55,199 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/classes/test/data/apache.10.txt"]
2016-01-14 19:19:55,200 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/checkpointplatform/testRestartCheckpoint/restartcheckpoint"]
2016-01-14 19:19:55,200 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] parallel execution of steps is enabled: true
2016-01-14 19:19:55,200 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] executing total steps: 2
2016-01-14 19:19:55,201 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] allocating management threads: 2
2016-01-14 19:19:55,209 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] at least one sink is marked for delete
2016-01-14 19:19:55,209 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-01-14 19:19:55,213 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] source modification date at: Thu Jan 14 19:19:08 UTC 2016
2016-01-14 19:19:55,215 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] sink oldest modified date: Thu Jan 14 19:19:08 UTC 2016
2016-01-14 19:19:55,217 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] source modification date at: Thu Jan 14 19:17:57 UTC 2016
2016-01-14 19:19:55,217 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] skipping step: (1/2)
2016-01-14 19:19:55,220 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] starting step: (2/2) ...ckpoint/restartcheckpoint
2016-01-14 19:19:55,379 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] submitted hadoop job: job_1452799071795_0006
2016-01-14 19:19:55,379 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] tracking url: http://ip-10-167-78-165.ec2.internal:48225/proxy/application_1452799071795_0006/
2016-01-14 19:20:11,087 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0006_01_000003 is : 143
2016-01-14 19:20:11,489 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0006_01_000004 is : 143
2016-01-14 19:20:11,545 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0006_01_000002 is : 143
2016-01-14 19:20:11,829 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0006_01_000005 is : 143
2016-01-14 19:20:17,493 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0006_01_000006 is : 143
2016-01-14 19:20:18,735 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/checkpointplatform/testRestartCheckpoint/restartcheckpoint/_temporary
2016-01-14 19:20:18,737 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] completed in: 00:23.530, using cpu time: 00:04.920
2016-01-14 19:20:18,756 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/checkpointplatform/testRestartCheckpoint/restartcheckpoint
2016-01-14 19:20:18,784 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 19:20:18,784 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 19:20:18,792 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] executed rule registry: MapReduceHadoopRuleRegistry, completed as: ILLEGAL, in: 00:00.002
2016-01-14 19:20:18,793 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] rule registry: MapReduceHadoopRuleRegistry, found assembly to be malformed
2016-01-14 19:20:18,793 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/checkpointplatform/testFailCheckpointBeforeEvery/failcheckpointevery/sink
2016-01-14 19:20:18,794 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/checkpointplatform/testFailCheckpointBeforeEvery/failcheckpointevery/tap
2016-01-14 19:20:18,811 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 19:20:18,811 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 19:20:18,874 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.058
2016-01-14 19:20:18,876 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 2, nodes: 3
2016-01-14 19:20:18,876 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 19:20:18,900 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] starting
2016-01-14 19:20:18,900 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/classes/test/data/apache.10.txt"]
2016-01-14 19:20:18,901 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/checkpointplatform/testSimpleCheckpoint/simplecheckpoint"]
2016-01-14 19:20:18,901 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] parallel execution of steps is enabled: true
2016-01-14 19:20:18,901 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] executing total steps: 2
2016-01-14 19:20:18,901 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] allocating management threads: 2
2016-01-14 19:20:18,903 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] starting step: (1/2)
2016-01-14 19:20:19,034 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] submitted hadoop job: job_1452799071795_0007
2016-01-14 19:20:19,034 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] tracking url: http://ip-10-167-78-165.ec2.internal:48225/proxy/application_1452799071795_0007/
2016-01-14 19:20:34,599 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0007_01_000002 is : 143
2016-01-14 19:20:34,794 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0007_01_000003 is : 143
2016-01-14 19:20:34,830 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0007_01_000004 is : 143
2016-01-14 19:20:34,885 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0007_01_000005 is : 143
2016-01-14 19:20:36,091 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] starting step: (2/2) ...eckpoint/simplecheckpoint
2016-01-14 19:20:36,232 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] submitted hadoop job: job_1452799071795_0008
2016-01-14 19:20:36,232 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] tracking url: http://ip-10-167-78-165.ec2.internal:48225/proxy/application_1452799071795_0008/
2016-01-14 19:20:51,662 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0008_01_000003 is : 143
2016-01-14 19:20:51,900 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0008_01_000002 is : 143
2016-01-14 19:20:51,998 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0008_01_000005 is : 143
2016-01-14 19:20:52,137 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0008_01_000004 is : 143
2016-01-14 19:20:58,310 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0008_01_000006 is : 143
2016-01-14 19:20:59,536 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/checkpointplatform/testSimpleCheckpoint/simplecheckpoint/_temporary
2016-01-14 19:20:59,538 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] completed in: 00:40.632, using cpu time: 00:09.310
2016-01-14 19:20:59,555 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/checkpointplatform/testSimpleCheckpoint/simplecheckpoint
2016-01-14 19:20:59,578 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 19:20:59,579 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 19:20:59,600 INFO planner.FlowPlanner (FlowPlanner.java:makeTempTap(767)) - found checkpoint: checkpoint, using tap: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/checkpointplatform/testSimpleCheckpointTextIntermediate/checkpoint/tap"]
2016-01-14 19:20:59,654 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.067
2016-01-14 19:20:59,658 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 2, nodes: 3
2016-01-14 19:20:59,658 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 19:20:59,688 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] starting
2016-01-14 19:20:59,689 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/classes/test/data/apache.10.txt"]
2016-01-14 19:20:59,689 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/checkpointplatform/testSimpleCheckpointTextIntermediate/checkpoint/sink"]
2016-01-14 19:20:59,689 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] parallel execution of steps is enabled: true
2016-01-14 19:20:59,690 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] executing total steps: 2
2016-01-14 19:20:59,690 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] allocating management threads: 2
2016-01-14 19:20:59,691 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] starting step: (1/2) ...termediate/checkpoint/tap
2016-01-14 19:20:59,847 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] submitted hadoop job: job_1452799071795_0009
2016-01-14 19:20:59,847 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] tracking url: http://ip-10-167-78-165.ec2.internal:48225/proxy/application_1452799071795_0009/
2016-01-14 19:21:15,097 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0009_01_000002 is : 143
2016-01-14 19:21:15,253 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0009_01_000004 is : 143
2016-01-14 19:21:15,464 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0009_01_000005 is : 143
2016-01-14 19:21:16,189 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0009_01_000003 is : 143
2016-01-14 19:21:17,375 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] starting step: (2/2) ...ermediate/checkpoint/sink
2016-01-14 19:21:17,521 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] submitted hadoop job: job_1452799071795_0010
2016-01-14 19:21:17,521 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] tracking url: http://ip-10-167-78-165.ec2.internal:48225/proxy/application_1452799071795_0010/
2016-01-14 19:21:37,075 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0010_01_000003 is : 143
2016-01-14 19:21:37,544 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0010_01_000002 is : 143
2016-01-14 19:21:38,102 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0010_01_000006 is : 143
2016-01-14 19:21:38,221 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0010_01_000005 is : 143
2016-01-14 19:21:38,390 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0010_01_000007 is : 143
2016-01-14 19:21:38,434 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0010_01_000004 is : 143
2016-01-14 19:21:43,919 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452799071795_0010_01_000008 is : 143
2016-01-14 19:21:45,138 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/checkpointplatform/testSimpleCheckpointTextIntermediate/checkpoint/tap/_temporary
2016-01-14 19:21:45,140 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output/hadoop2-mr1/checkpointplatform/testSimpleCheckpointTextIntermediate/checkpoint/sink/_temporary
2016-01-14 19:21:45,142 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] completed in: 00:45.445, using cpu time: 00:11.510
2016-01-14 19:21:45,183 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/checkpointplatform/testSimpleCheckpointTextIntermediate/checkpoint/sink
2016-01-14 19:21:45,187 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/checkpointplatform/testSimpleCheckpointTextIntermediate/checkpoint/tap
2016-01-14 19:21:45,221 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 19:21:45,221 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 19:21:45,225 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/checkpointplatform/testDuplicateCheckpoint/duplicatecheckpoint
2016-01-14 19:21:45,240 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 19:21:45,240 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 19:21:45,243 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/checkpointplatform/testFailCheckpoint/failcheckpoint/tap
2016-01-14 19:21:45,244 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/checkpointplatform/testFailCheckpoint/failcheckpoint/sink
2016-01-14 19:21:45,259 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 19:21:45,259 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 19:21:45,262 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/checkpointplatform/testFailCheckpointDeclaredFields/failcheckpointdeclared/tap
2016-01-14 19:21:45,263 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.3.x/build/test/output//hadoop2-mr1/checkpointplatform/testFailCheckpointDeclaredFields/failcheckpointdeclared/sink