2016-01-14 16:58:07,068 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(195)) - found 1 test platforms from classpath
2016-01-14 16:58:07,096 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(244)) - adding test: cascading.scheme.hadoop.WritableSequenceFilePlatformTest, with platform: hadoop2-mr1
2016-01-14 16:58:07,129 INFO hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(136)) - using cluster
2016-01-14 16:58:07,934 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
2016-01-14 16:58:08,504 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2016-01-14 16:58:13,416 WARN containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-14 16:58:14,607 WARN containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-14 16:58:15,758 WARN containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-14 16:58:16,900 WARN containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-14 16:58:19,451 INFO platform.TestPlatform (TestPlatform.java:getGlobalProperties(73)) - platform property overrides:
2016-01-14 16:58:19,640 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:58:19,641 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 16:58:19,709 INFO property.AppProps (AppProps.java:getAppID(177)) - using app.id: D3876587389F47DC95242BE99C75B127
2016-01-14 16:58:19,822 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.076
2016-01-14 16:58:19,824 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:58:19,825 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:58:19,932 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:58:19,933 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 16:58:19,977 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.037
2016-01-14 16:58:19,979 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:58:19,979 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:58:20,011 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 16:58:20,011 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 16:58:20,077 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.057
2016-01-14 16:58:20,078 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 16:58:20,079 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 16:58:20,100 INFO util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.0.4
2016-01-14 16:58:20,100 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] starting
2016-01-14 16:58:20,105 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] parallel execution of flows is enabled: true
2016-01-14 16:58:20,105 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] executing total flows: 3
2016-01-14 16:58:20,105 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] allocating management threads: 3
2016-01-14 16:58:20,106 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] starting flow: keyvalue
2016-01-14 16:58:20,107 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] at least one sink is marked for delete
2016-01-14 16:58:20,107 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-01-14 16:58:20,128 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] starting
2016-01-14 16:58:20,129 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/classes/test/data/apache.10.txt"]
2016-01-14 16:58:20,129 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] sink: Hfs["WritableSequenceFile[['offset', 'line']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/keyvalue"]
2016-01-14 16:58:20,129 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] parallel execution of steps is enabled: true
2016-01-14 16:58:20,130 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] executing total steps: 1
2016-01-14 16:58:20,130 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] allocating management threads: 1
2016-01-14 16:58:20,131 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] starting step: (1/1) ...orm/testWritable/keyvalue
2016-01-14 16:58:20,803 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] submitted hadoop job: job_1452790691566_0001
2016-01-14 16:58:20,803 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] tracking url: http://ip-10-167-78-165:49722/proxy/application_1452790691566_0001/
2016-01-14 16:58:37,979 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452790691566_0001_01_000005 is : 143
2016-01-14 16:58:38,140 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452790691566_0001_01_000002 is : 143
2016-01-14 16:58:38,214 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452790691566_0001_01_000004 is : 143
2016-01-14 16:58:38,380 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452790691566_0001_01_000003 is : 143
2016-01-14 16:58:39,706 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/keyvalue/_temporary
2016-01-14 16:58:39,707 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] completed in: 00:19.573, using cpu time: 00:06.040
2016-01-14 16:58:39,708 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] completed flow: keyvalue
2016-01-14 16:58:39,708 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] starting flow: value
2016-01-14 16:58:39,708 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] at least one sink is marked for delete
2016-01-14 16:58:39,709 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-01-14 16:58:39,709 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] starting flow: key
2016-01-14 16:58:39,710 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] at least one sink is marked for delete
2016-01-14 16:58:39,710 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-01-14 16:58:39,713 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] starting
2016-01-14 16:58:39,713 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] source: Hfs["WritableSequenceFile[['offset', 'line']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/keyvalue"]
2016-01-14 16:58:39,714 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] sink: Hfs["WritableSequenceFile[['line']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/value"]
2016-01-14 16:58:39,716 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] starting
2016-01-14 16:58:39,716 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] source: Hfs["WritableSequenceFile[['offset', 'line']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/keyvalue"]
2016-01-14 16:58:39,716 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] parallel execution of steps is enabled: true
2016-01-14 16:58:39,716 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] executing total steps: 1
2016-01-14 16:58:39,716 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] sink: Hfs["WritableSequenceFile[['offset']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/key"]
2016-01-14 16:58:39,717 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] parallel execution of steps is enabled: true
2016-01-14 16:58:39,717 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] executing total steps: 1
2016-01-14 16:58:39,717 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] allocating management threads: 1
2016-01-14 16:58:39,717 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] allocating management threads: 1
2016-01-14 16:58:39,719 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] starting step: (1/1) ...atform/testWritable/value
2016-01-14 16:58:39,719 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] starting step: (1/1) ...platform/testWritable/key
2016-01-14 16:58:39,968 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] submitted hadoop job: job_1452790691566_0002
2016-01-14 16:58:39,969 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] tracking url: http://ip-10-167-78-165:49722/proxy/application_1452790691566_0002/
2016-01-14 16:58:39,986 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] submitted hadoop job: job_1452790691566_0003
2016-01-14 16:58:39,986 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] tracking url: http://ip-10-167-78-165:49722/proxy/application_1452790691566_0003/
2016-01-14 16:58:58,032 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452790691566_0002_01_000002 is : 143
2016-01-14 16:58:58,351 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452790691566_0002_01_000003 is : 143
2016-01-14 16:58:58,963 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452790691566_0002_01_000005 is : 143
2016-01-14 16:58:59,177 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452790691566_0002_01_000004 is : 143
2016-01-14 16:59:00,600 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/value/_temporary
2016-01-14 16:59:00,603 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] completed in: 00:20.884, using cpu time: 00:03.770
2016-01-14 16:59:00,603 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] completed flow: value
2016-01-14 16:59:08,877 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452790691566_0003_01_000004 is : 143
2016-01-14 16:59:08,959 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452790691566_0003_01_000003 is : 143
2016-01-14 16:59:09,080 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452790691566_0003_01_000002 is : 143
2016-01-14 16:59:09,152 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452790691566_0003_01_000005 is : 143
2016-01-14 16:59:10,385 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/key/_temporary
2016-01-14 16:59:10,387 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] completed in: 00:30.667, using cpu time: 00:03.530
2016-01-14 16:59:10,387 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] completed flow: key
2016-01-14 16:59:10,499 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/writablesequencefileplatform/testWritable/value
2016-01-14 16:59:10,515 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/writablesequencefileplatform/testWritable/keyvalue
2016-01-14 16:59:10,531 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.2.x/build/test/output//hadoop2-mr1/writablesequencefileplatform/testWritable/key