2015-08-14 04:03:54,136 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(187)) - found 1 test platforms from classpath
2015-08-14 04:03:54,195 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(237)) - installing platform: hadoop2-mr1
2015-08-14 04:03:54,195 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(238)) - running test: cascading.scheme.hadoop.WritableSequenceFilePlatformTest
2015-08-14 04:03:54,231 INFO hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(121)) - using cluster
2015-08-14 04:03:55,135 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
2015-08-14 04:03:55,929 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2015-08-14 04:03:56,538 WARN server.AuthenticationFilter (AuthenticationFilter.java:init(158)) - 'signature.secret' configuration not set, using a random value as secret
2015-08-14 04:04:00,172 WARN containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-08-14 04:04:00,405 WARN containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-08-14 04:04:00,580 WARN containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-08-14 04:04:00,770 WARN containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-08-14 04:04:17,884 INFO platform.TestPlatform (TestPlatform.java:getGlobalProperties(72)) - platform property overrides:
2015-08-14 04:04:18,195 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-08-14 04:04:18,197 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.1/78a07fbd83388056abdb4b5e48f666735b06cf7c/cascading-hadoop2-mr1-2.7.1.jar
2015-08-14 04:04:18,210 INFO property.AppProps (AppProps.java:getAppID(169)) - using app.id: A413DC16AF9343E5B800D585C3C27ECB
2015-08-14 04:04:18,435 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-08-14 04:04:18,436 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.1/78a07fbd83388056abdb4b5e48f666735b06cf7c/cascading-hadoop2-mr1-2.7.1.jar
2015-08-14 04:04:18,481 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-08-14 04:04:18,482 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.1/78a07fbd83388056abdb4b5e48f666735b06cf7c/cascading-hadoop2-mr1-2.7.1.jar
2015-08-14 04:04:18,517 INFO util.Version (Version.java:printBanner(85)) - Concurrent, Inc - Cascading 2.7.1
2015-08-14 04:04:18,518 INFO cascade.Cascade (Cascade.java:logInfo(996)) - [keyvalues] starting
2015-08-14 04:04:18,524 INFO cascade.Cascade (Cascade.java:logInfo(996)) - [keyvalues] parallel execution is enabled: true
2015-08-14 04:04:18,524 INFO cascade.Cascade (Cascade.java:logInfo(996)) - [keyvalues] starting flows: 3
2015-08-14 04:04:18,524 INFO cascade.Cascade (Cascade.java:logInfo(996)) - [keyvalues] allocating threads: 3
2015-08-14 04:04:18,525 INFO cascade.Cascade (Cascade.java:logInfo(996)) - [keyvalues] starting flow: keyvalue
2015-08-14 04:04:18,528 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [keyvalue] at least one sink is marked for delete
2015-08-14 04:04:18,528 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [keyvalue] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2015-08-14 04:04:18,557 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [keyvalue] starting
2015-08-14 04:04:18,558 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [keyvalue] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/8c57748d0461e126/apache-2.3.x/build/classes/test/data/apache.10.txt"]
2015-08-14 04:04:18,559 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [keyvalue] sink: Hfs["WritableSequenceFile[['offset', 'line']]"]["/opt/buildAgent-8.0.3/work/8c57748d0461e126/apache-2.3.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/keyvalue"]
2015-08-14 04:04:18,559 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [keyvalue] parallel execution is enabled: true
2015-08-14 04:04:18,560 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [keyvalue] starting jobs: 1
2015-08-14 04:04:18,561 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [keyvalue] allocating threads: 1
2015-08-14 04:04:18,562 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [keyvalue] starting step: (1/1) ...encefileplatform/keyvalue
2015-08-14 04:04:19,424 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [keyvalue] submitted hadoop job: job_1439525052381_0001
2015-08-14 04:04:19,424 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [keyvalue] tracking url: http://ip-10-235-34-50.ec2.internal:50554/proxy/application_1439525052381_0001/
2015-08-14 04:04:33,784 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1439525052381_0001_01_000004 is : 143
2015-08-14 04:04:33,842 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1439525052381_0001_01_000002 is : 143
2015-08-14 04:04:34,015 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1439525052381_0001_01_000005 is : 143
2015-08-14 04:04:34,925 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1439525052381_0001_01_000003 is : 143
2015-08-14 04:04:36,378 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/8c57748d0461e126/apache-2.3.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/keyvalue/_temporary
2015-08-14 04:04:36,380 INFO cascade.Cascade (Cascade.java:logInfo(996)) - [keyvalues] completed flow: keyvalue
2015-08-14 04:04:36,381 INFO cascade.Cascade (Cascade.java:logInfo(996)) - [keyvalues] starting flow: value
2015-08-14 04:04:36,381 INFO cascade.Cascade (Cascade.java:logInfo(996)) - [keyvalues] starting flow: key
2015-08-14 04:04:36,382 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [value] at least one sink is marked for delete
2015-08-14 04:04:36,382 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [key] at least one sink is marked for delete
2015-08-14 04:04:36,382 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [value] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2015-08-14 04:04:36,382 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [key] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2015-08-14 04:04:36,389 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [key] starting
2015-08-14 04:04:36,390 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [key] source: Hfs["WritableSequenceFile[['offset', 'line']]"]["/opt/buildAgent-8.0.3/work/8c57748d0461e126/apache-2.3.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/keyvalue"]
2015-08-14 04:04:36,390 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [key] sink: Hfs["WritableSequenceFile[['offset']]"]["/opt/buildAgent-8.0.3/work/8c57748d0461e126/apache-2.3.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/key"]
2015-08-14 04:04:36,392 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [value] starting
2015-08-14 04:04:36,392 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [key] parallel execution is enabled: true
2015-08-14 04:04:36,392 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [value] source: Hfs["WritableSequenceFile[['offset', 'line']]"]["/opt/buildAgent-8.0.3/work/8c57748d0461e126/apache-2.3.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/keyvalue"]
2015-08-14 04:04:36,393 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [key] starting jobs: 1
2015-08-14 04:04:36,393 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [value] sink: Hfs["WritableSequenceFile[['line']]"]["/opt/buildAgent-8.0.3/work/8c57748d0461e126/apache-2.3.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/value"]
2015-08-14 04:04:36,393 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [key] allocating threads: 1
2015-08-14 04:04:36,393 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [value] parallel execution is enabled: true
2015-08-14 04:04:36,394 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [value] starting jobs: 1
2015-08-14 04:04:36,394 INFO flow.Flow (BaseFlow.java:logInfo(1370)) - [value] allocating threads: 1
2015-08-14 04:04:36,395 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [key] starting step: (1/1) ...esequencefileplatform/key
2015-08-14 04:04:36,396 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [value] starting step: (1/1) ...equencefileplatform/value
2015-08-14 04:04:36,726 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [key] submitted hadoop job: job_1439525052381_0002
2015-08-14 04:04:36,726 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [key] tracking url: http://ip-10-235-34-50.ec2.internal:50554/proxy/application_1439525052381_0002/
2015-08-14 04:04:36,763 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [value] submitted hadoop job: job_1439525052381_0003
2015-08-14 04:04:36,763 INFO flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [value] tracking url: http://ip-10-235-34-50.ec2.internal:50554/proxy/application_1439525052381_0003/
2015-08-14 04:04:51,329 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1439525052381_0002_01_000003 is : 143
2015-08-14 04:04:51,369 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1439525052381_0002_01_000004 is : 143
2015-08-14 04:04:51,629 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1439525052381_0002_01_000005 is : 143
2015-08-14 04:04:51,698 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1439525052381_0002_01_000002 is : 143
2015-08-14 04:04:53,008 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/8c57748d0461e126/apache-2.3.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/key/_temporary
2015-08-14 04:04:53,010 INFO cascade.Cascade (Cascade.java:logInfo(996)) - [keyvalues] completed flow: key
2015-08-14 04:04:57,688 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1439525052381_0003_01_000004 is : 143
2015-08-14 04:04:57,828 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1439525052381_0003_01_000005 is : 143
2015-08-14 04:04:58,012 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1439525052381_0003_01_000002 is : 143
2015-08-14 04:04:58,094 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1439525052381_0003_01_000003 is : 143
2015-08-14 04:04:59,401 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/8c57748d0461e126/apache-2.3.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/value/_temporary
2015-08-14 04:04:59,402 INFO cascade.Cascade (Cascade.java:logInfo(996)) - [keyvalues] completed flow: value
2015-08-14 04:04:59,565 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/8c57748d0461e126/apache-2.3.x/build/test/output//hadoop2-mr1/writablesequencefileplatform/key
2015-08-14 04:04:59,584 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/8c57748d0461e126/apache-2.3.x/build/test/output//hadoop2-mr1/writablesequencefileplatform/keyvalue
2015-08-14 04:04:59,603 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/8c57748d0461e126/apache-2.3.x/build/test/output//hadoop2-mr1/writablesequencefileplatform/value