2015-08-12 19:45:17,836 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(195)) - found 1 test platforms from classpath
2015-08-12 19:45:17,927 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(244)) - adding test: cascading.pipe.checkpoint.CheckpointPlatformTest, with platform: hadoop2-mr1
2015-08-12 19:45:18,002 INFO hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(136)) - using cluster
2015-08-12 19:45:19,272 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
2015-08-12 19:45:20,021 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2015-08-12 19:45:26,250 WARN containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-08-12 19:45:26,480 WARN containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-08-12 19:45:26,735 WARN containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-08-12 19:45:26,948 WARN containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-08-12 19:45:44,102 INFO platform.TestPlatform (TestPlatform.java:getGlobalProperties(73)) - platform property overrides:
2015-08-12 19:45:44,281 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-08-12 19:45:44,284 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-08-12 19:45:44,419 INFO property.AppProps (AppProps.java:getAppID(177)) - using app.id: D18BC2BB1D0640478CDF6F72B28CE81A
2015-08-12 19:45:44,541 INFO planner.FlowPlanner (FlowPlanner.java:decorateTap(797)) - found decorator: cascading.flowconnector.checkpoint_tap.decorator.classname, wrapping tap: TempHfs["null"][6028650215/test/]
2015-08-12 19:45:44,705 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.213
2015-08-12 19:45:44,711 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 3, nodes: 4
2015-08-12 19:45:44,714 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-08-12 19:45:44,964 INFO util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.0.2
2015-08-12 19:45:44,974 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] starting
2015-08-12 19:45:44,975 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/cascading/cascading.compatibility/biginsights-4.0.x/build/classes/test/data/apache.10.txt"]
2015-08-12 19:45:44,975 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/cascading/cascading.compatibility/biginsights-4.0.x/build/test/output/hadoop2-mr1/checkpointplatform/testManyCheckpoints/manycheckpoint"]
2015-08-12 19:45:44,977 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] parallel execution of steps is enabled: true
2015-08-12 19:45:44,977 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] executing total steps: 3
2015-08-12 19:45:44,977 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] allocating management threads: 3
2015-08-12 19:45:44,981 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] starting step: (1/3)
2015-08-12 19:45:45,937 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] submitted hadoop job: job_1439433938589_0001
2015-08-12 19:45:45,938 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] tracking url: http://node1.bidemo.com:48585/proxy/application_1439433938589_0001/
2015-08-12 19:46:15,595 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1439433938589_0001_01_000002 is : 143
2015-08-12 19:46:16,134 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1439433938589_0001_01_000003 is : 143
2015-08-12 19:46:17,620 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] starting step: (2/3)
2015-08-12 19:46:18,117 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] submitted hadoop job: job_1439433938589_0002
2015-08-12 19:46:18,118 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] tracking url: http://node1.bidemo.com:48585/proxy/application_1439433938589_0002/
2015-08-12 19:46:44,815 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1439433938589_0002_01_000003 is : 143
2015-08-12 19:46:44,884 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1439433938589_0002_01_000004 is : 143
2015-08-12 19:46:53,110 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1439433938589_0002_01_000006 is : 143
2015-08-12 19:46:54,440 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] starting step: (3/3) ...heckpoints/manycheckpoint
2015-08-12 19:46:54,855 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] submitted hadoop job: job_1439433938589_0003
2015-08-12 19:46:54,855 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] tracking url: http://node1.bidemo.com:48585/proxy/application_1439433938589_0003/
2015-08-12 19:47:10,312 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1439433938589_0003_01_000002 is : 143
2015-08-12 19:47:11,751 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /home/cascading/cascading.compatibility/biginsights-4.0.x/build/test/output/hadoop2-mr1/checkpointplatform/testManyCheckpoints/manycheckpoint/_temporary
2015-08-12 19:47:11,756 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] completed in: 01:26.765, using cpu time: 00:11.050
2015-08-12 19:47:11,817 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /home/cascading/cascading.compatibility/biginsights-4.0.x/build/test/output//hadoop2-mr1/checkpointplatform/testManyCheckpoints/manycheckpoint
2015-08-12 19:47:11,869 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-08-12 19:47:11,870 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-08-12 19:47:11,972 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.095
2015-08-12 19:47:11,974 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 2, nodes: 3
2015-08-12 19:47:11,975 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-08-12 19:47:12,017 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] starting
2015-08-12 19:47:12,018 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/cascading/cascading.compatibility/biginsights-4.0.x/build/classes/test/data/apache.10.txt"]
2015-08-12 19:47:12,018 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/cascading/cascading.compatibility/biginsights-4.0.x/build/test/output/hadoop2-mr1/checkpointplatform/testRestartCheckpoint/restartcheckpoint"]
2015-08-12 19:47:12,018 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] parallel execution of steps is enabled: true
2015-08-12 19:47:12,019 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] executing total steps: 2
2015-08-12 19:47:12,019 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] allocating management threads: 2
2015-08-12 19:47:12,032 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] at least one sink does not exist
2015-08-12 19:47:12,040 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] source modification date at: Wed Aug 12 19:45:44 PDT 2015
2015-08-12 19:47:12,042 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] starting step: (1/2)
2015-08-12 19:47:12,299 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] submitted hadoop job: job_1439433938589_0004
2015-08-12 19:47:12,299 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] tracking url: http://node1.bidemo.com:48585/proxy/application_1439433938589_0004/
2015-08-12 19:47:37,910 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1439433938589_0004_01_000004 is : 143
2015-08-12 19:47:39,195 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1439433938589_0004_01_000002 is : 143
2015-08-12 19:47:40,684 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] starting step: (2/2) ...ckpoint/restartcheckpoint
2015-08-12 19:47:40,971 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] submitted hadoop job: job_1439433938589_0005
2015-08-12 19:47:40,971 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] tracking url: http://node1.bidemo.com:48585/proxy/application_1439433938589_0005/
2015-08-12 19:48:07,096 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1439433938589_0005_01_000005 is : 143
2015-08-12 19:48:07,843 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1439433938589_0005_01_000002 is : 143
2015-08-12 19:48:23,910 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1439433938589_0005_01_000007 is : 143
2015-08-12 19:48:32,139 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1439433938589_0005_01_000008 is : 143
2015-08-12 19:48:41,330 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1439433938589_0005_01_000009 is : 143
2015-08-12 19:48:42,526 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [restartable] hadoop job job_1439433938589_0005 state at FAILED
2015-08-12 19:48:42,529 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [restartable] failure info: Task failed task_1439433938589_0005_r_000000
Job failed as tasks failed. failedMaps:0 failedReduces:1
2015-08-12 19:48:42,573 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [restartable] task completion events identify failed tasks
2015-08-12 19:48:42,573 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [restartable] task completion events count: 8
2015-08-12 19:48:42,575 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [restartable] event = Task Id : attempt_1439433938589_0005_m_000003_0, Status : SUCCEEDED
2015-08-12 19:48:42,575 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [restartable] event = Task Id : attempt_1439433938589_0005_m_000001_0, Status : SUCCEEDED
2015-08-12 19:48:42,576 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [restartable] event = Task Id : attempt_1439433938589_0005_m_000002_0, Status : SUCCEEDED
2015-08-12 19:48:42,576 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [restartable] event = Task Id : attempt_1439433938589_0005_m_000000_0, Status : SUCCEEDED
2015-08-12 19:48:42,576 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [restartable] event = Task Id : attempt_1439433938589_0005_r_000000_0, Status : FAILED
2015-08-12 19:48:42,576 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [restartable] event = Task Id : attempt_1439433938589_0005_r_000000_1, Status : FAILED
2015-08-12 19:48:42,576 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [restartable] event = Task Id : attempt_1439433938589_0005_r_000000_2, Status : FAILED
2015-08-12 19:48:42,576 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [restartable] event = Task Id : attempt_1439433938589_0005_r_000000_3, Status : TIPFAILED
2015-08-12 19:48:42,700 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] stopping all jobs
2015-08-12 19:48:42,706 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] stopping: (2/2) ...ckpoint/restartcheckpoint
2015-08-12 19:48:42,712 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] stopping: (1/2)
2015-08-12 19:48:46,455 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] stopped all jobs
2015-08-12 19:48:46,456 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /tmp/hadoop-root/restartable/restartable/test/_temporary
2015-08-12 19:48:46,460 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /home/cascading/cascading.compatibility/biginsights-4.0.x/build/test/output/hadoop2-mr1/checkpointplatform/testRestartCheckpoint/restartcheckpoint/_temporary
2015-08-12 19:48:46,463 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] completed in: 01:34.438, using cpu time: 00:08.540
2015-08-12 19:48:46,535 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-08-12 19:48:46,536 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-08-12 19:48:46,732 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.187
2015-08-12 19:48:46,766 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 2, nodes: 3
2015-08-12 19:48:46,766 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-08-12 19:48:46,831 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] starting
2015-08-12 19:48:46,832 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/cascading/cascading.compatibility/biginsights-4.0.x/build/classes/test/data/apache.10.txt"]
2015-08-12 19:48:46,834 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/cascading/cascading.compatibility/biginsights-4.0.x/build/test/output/hadoop2-mr1/checkpointplatform/testRestartCheckpoint/restartcheckpoint"]
2015-08-12 19:48:46,835 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] parallel execution of steps is enabled: true
2015-08-12 19:48:46,836 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] executing total steps: 2
2015-08-12 19:48:46,837 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] allocating management threads: 2
2015-08-12 19:48:46,842 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] at least one sink is marked for delete
2015-08-12 19:48:46,842 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] sink oldest modified date: Wed Dec 31 15:59:59 PST 1969
2015-08-12 19:48:46,850 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] source modification date at: Wed Aug 12 19:47:39 PDT 2015
2015-08-12 19:48:46,853 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] sink oldest modified date: Wed Aug 12 19:47:39 PDT 2015
2015-08-12 19:48:46,859 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] source modification date at: Wed Aug 12 19:45:44 PDT 2015
2015-08-12 19:48:46,860 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] skipping step: (1/2)
2015-08-12 19:48:46,861 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] starting step: (2/2) ...ckpoint/restartcheckpoint
2015-08-12 19:48:47,537 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] submitted hadoop job: job_1439433938589_0006
2015-08-12 19:48:47,537 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] tracking url: http://node1.bidemo.com:48585/proxy/application_1439433938589_0006/
2015-08-12 19:49:27,085 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1439433938589_0006_01_000003 is : 143
2015-08-12 19:49:36,723 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1439433938589_0006_01_000006 is : 143
2015-08-12 19:49:38,049 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /home/cascading/cascading.compatibility/biginsights-4.0.x/build/test/output/hadoop2-mr1/checkpointplatform/testRestartCheckpoint/restartcheckpoint/_temporary
2015-08-12 19:49:38,054 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [restartable] completed in: 00:51.210, using cpu time: 00:08.290
2015-08-12 19:49:38,091 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /home/cascading/cascading.compatibility/biginsights-4.0.x/build/test/output//hadoop2-mr1/checkpointplatform/testRestartCheckpoint/restartcheckpoint
2015-08-12 19:49:38,148 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-08-12 19:49:38,148 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-08-12 19:49:38,160 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] executed rule registry: MapReduceHadoopRuleRegistry, completed as: ILLEGAL, in: 00:00.003
2015-08-12 19:49:38,162 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] rule registry: MapReduceHadoopRuleRegistry, found assembly to be malformed
2015-08-12 19:49:38,163 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /home/cascading/cascading.compatibility/biginsights-4.0.x/build/test/output//hadoop2-mr1/checkpointplatform/testFailCheckpointBeforeEvery/failcheckpointevery/sink
2015-08-12 19:49:38,164 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /home/cascading/cascading.compatibility/biginsights-4.0.x/build/test/output//hadoop2-mr1/checkpointplatform/testFailCheckpointBeforeEvery/failcheckpointevery/tap
2015-08-12 19:49:38,199 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-08-12 19:49:38,201 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-08-12 19:49:38,335 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.109
2015-08-12 19:49:38,337 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 2, nodes: 3
2015-08-12 19:49:38,337 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-08-12 19:49:38,380 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] starting
2015-08-12 19:49:38,381 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/cascading/cascading.compatibility/biginsights-4.0.x/build/classes/test/data/apache.10.txt"]
2015-08-12 19:49:38,382 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/cascading/cascading.compatibility/biginsights-4.0.x/build/test/output/hadoop2-mr1/checkpointplatform/testSimpleCheckpoint/simplecheckpoint"]
2015-08-12 19:49:38,382 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] parallel execution of steps is enabled: true
2015-08-12 19:49:38,385 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] executing total steps: 2
2015-08-12 19:49:38,385 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] allocating management threads: 2
2015-08-12 19:49:38,396 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] starting step: (1/2)
2015-08-12 19:49:38,666 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] submitted hadoop job: job_1439433938589_0007
2015-08-12 19:49:38,666 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] tracking url: http://node1.bidemo.com:48585/proxy/application_1439433938589_0007/
2015-08-12 19:50:08,909 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1439433938589_0007_01_000005 is : 143
2015-08-12 19:50:11,428 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] starting step: (2/2) ...eckpoint/simplecheckpoint
2015-08-12 19:50:11,873 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] submitted hadoop job: job_1439433938589_0008
2015-08-12 19:50:11,873 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] tracking url: http://node1.bidemo.com:48585/proxy/application_1439433938589_0008/
2015-08-12 19:50:43,763 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1439433938589_0008_01_000005 is : 143
2015-08-12 19:50:51,496 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1439433938589_0008_01_000006 is : 143
2015-08-12 19:50:53,386 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /home/cascading/cascading.compatibility/biginsights-4.0.x/build/test/output/hadoop2-mr1/checkpointplatform/testSimpleCheckpoint/simplecheckpoint/_temporary
2015-08-12 19:50:53,393 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] completed in: 01:14.999, using cpu time: 00:10.690
2015-08-12 19:50:53,423 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /home/cascading/cascading.compatibility/biginsights-4.0.x/build/test/output//hadoop2-mr1/checkpointplatform/testSimpleCheckpoint/simplecheckpoint
2015-08-12 19:50:53,471 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-08-12 19:50:53,474 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-08-12 19:50:53,495 INFO planner.FlowPlanner (FlowPlanner.java:makeTempTap(767)) - found checkpoint: checkpoint, using tap: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/home/cascading/cascading.compatibility/biginsights-4.0.x/build/test/output/hadoop2-mr1/checkpointplatform/testSimpleCheckpointTextIntermediate/checkpoint/tap"]
2015-08-12 19:50:53,553 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.071
2015-08-12 19:50:53,557 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 2, nodes: 3
2015-08-12 19:50:53,558 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-08-12 19:50:53,603 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] starting
2015-08-12 19:50:53,604 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/cascading/cascading.compatibility/biginsights-4.0.x/build/classes/test/data/apache.10.txt"]
2015-08-12 19:50:53,605 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/cascading/cascading.compatibility/biginsights-4.0.x/build/test/output/hadoop2-mr1/checkpointplatform/testSimpleCheckpointTextIntermediate/checkpoint/sink"]
2015-08-12 19:50:53,605 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] parallel execution of steps is enabled: true
2015-08-12 19:50:53,605 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] executing total steps: 2
2015-08-12 19:50:53,605 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] allocating management threads: 2
2015-08-12 19:50:53,614 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] starting step: (1/2) ...termediate/checkpoint/tap
2015-08-12 19:50:53,871 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] submitted hadoop job: job_1439433938589_0009
2015-08-12 19:50:53,871 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] tracking url: http://node1.bidemo.com:48585/proxy/application_1439433938589_0009/
2015-08-12 19:51:23,942 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1439433938589_0009_01_000005 is : 143
2015-08-12 19:51:24,368 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1439433938589_0009_01_000002 is : 143
2015-08-12 19:51:25,751 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] starting step: (2/2) ...ermediate/checkpoint/sink
2015-08-12 19:51:26,005 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] submitted hadoop job: job_1439433938589_0010
2015-08-12 19:51:26,007 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] tracking url: http://node1.bidemo.com:48585/proxy/application_1439433938589_0010/
2015-08-12 19:52:04,362 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1439433938589_0010_01_000005 is : 143
2015-08-12 19:52:06,200 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1439433938589_0010_01_000004 is : 143
2015-08-12 19:52:16,463 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1439433938589_0010_01_000008 is : 143
2015-08-12 19:52:17,777 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /home/cascading/cascading.compatibility/biginsights-4.0.x/build/test/output/hadoop2-mr1/checkpointplatform/testSimpleCheckpointTextIntermediate/checkpoint/tap/_temporary
2015-08-12 19:52:17,789 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /home/cascading/cascading.compatibility/biginsights-4.0.x/build/test/output/hadoop2-mr1/checkpointplatform/testSimpleCheckpointTextIntermediate/checkpoint/sink/_temporary
2015-08-12 19:52:17,795 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] completed in: 01:24.171, using cpu time: 00:14.780
2015-08-12 19:52:17,866 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /home/cascading/cascading.compatibility/biginsights-4.0.x/build/test/output//hadoop2-mr1/checkpointplatform/testSimpleCheckpointTextIntermediate/checkpoint/tap
2015-08-12 19:52:17,894 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /home/cascading/cascading.compatibility/biginsights-4.0.x/build/test/output//hadoop2-mr1/checkpointplatform/testSimpleCheckpointTextIntermediate/checkpoint/sink
2015-08-12 19:52:17,943 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-08-12 19:52:17,943 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-08-12 19:52:17,948 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /home/cascading/cascading.compatibility/biginsights-4.0.x/build/test/output//hadoop2-mr1/checkpointplatform/testDuplicateCheckpoint/duplicatecheckpoint
2015-08-12 19:52:17,978 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-08-12 19:52:17,979 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-08-12 19:52:17,984 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /home/cascading/cascading.compatibility/biginsights-4.0.x/build/test/output//hadoop2-mr1/checkpointplatform/testFailCheckpoint/failcheckpoint/sink
2015-08-12 19:52:17,985 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /home/cascading/cascading.compatibility/biginsights-4.0.x/build/test/output//hadoop2-mr1/checkpointplatform/testFailCheckpoint/failcheckpoint/tap
2015-08-12 19:52:18,018 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-08-12 19:52:18,019 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-08-12 19:52:18,023 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /home/cascading/cascading.compatibility/biginsights-4.0.x/build/test/output//hadoop2-mr1/checkpointplatform/testFailCheckpointDeclaredFields/failcheckpointdeclared/tap
2015-08-12 19:52:18,025 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /home/cascading/cascading.compatibility/biginsights-4.0.x/build/test/output//hadoop2-mr1/checkpointplatform/testFailCheckpointDeclaredFields/failcheckpointdeclared/sink