2016-01-14 21:31:49,670 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(195)) - found 1 test platforms from classpath
2016-01-14 21:31:49,692 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(244)) - adding test: cascading.scheme.hadoop.WritableSequenceFilePlatformTest, with platform: hadoop2-mr1
2016-01-14 21:31:49,724 INFO hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(136)) - using cluster
2016-01-14 21:31:50,621 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
2016-01-14 21:31:51,422 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2016-01-14 21:31:51,973 WARN server.AuthenticationFilter (AuthenticationFilter.java:init(162)) - 'signature.secret' configuration not set, using a random value as secret
2016-01-14 21:31:54,985 WARN containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-14 21:31:55,128 WARN containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-14 21:31:55,247 WARN containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-14 21:31:55,366 WARN containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-14 21:32:12,442 INFO platform.TestPlatform (TestPlatform.java:getGlobalProperties(73)) - platform property overrides:
2016-01-14 21:32:12,672 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 21:32:12,673 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 21:32:12,745 INFO property.AppProps (AppProps.java:getAppID(177)) - using app.id: 51612D382E1C4BA7BEFE7136CE4172FF
2016-01-14 21:32:12,855 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.074
2016-01-14 21:32:12,858 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 21:32:12,859 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 21:32:12,970 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 21:32:12,970 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 21:32:13,011 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.034
2016-01-14 21:32:13,013 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 21:32:13,013 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 21:32:13,041 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 21:32:13,042 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 21:32:13,116 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.041
2016-01-14 21:32:13,117 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 21:32:13,117 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 21:32:13,137 INFO util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.0.4
2016-01-14 21:32:13,137 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] starting
2016-01-14 21:32:13,142 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] parallel execution of flows is enabled: true
2016-01-14 21:32:13,142 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] executing total flows: 3
2016-01-14 21:32:13,142 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] allocating management threads: 3
2016-01-14 21:32:13,143 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] starting flow: keyvalue
2016-01-14 21:32:13,143 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] at least one sink is marked for delete
2016-01-14 21:32:13,144 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-01-14 21:32:13,169 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] starting
2016-01-14 21:32:13,170 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/apache.10.txt"]
2016-01-14 21:32:13,170 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] sink: Hfs["WritableSequenceFile[['offset', 'line']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/keyvalue"]
2016-01-14 21:32:13,171 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] parallel execution of steps is enabled: true
2016-01-14 21:32:13,171 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] executing total steps: 1
2016-01-14 21:32:13,171 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] allocating management threads: 1
2016-01-14 21:32:13,172 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] starting step: (1/1) ...orm/testWritable/keyvalue
2016-01-14 21:32:14,249 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] submitted hadoop job: job_1452807126940_0001
2016-01-14 21:32:14,250 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] tracking url: http://ip-10-167-78-165:53004/proxy/application_1452807126940_0001/
2016-01-14 21:32:31,805 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452807126940_0001_01_000004 is : 143
2016-01-14 21:32:32,055 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452807126940_0001_01_000002 is : 143
2016-01-14 21:32:32,184 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452807126940_0001_01_000003 is : 143
2016-01-14 21:32:32,241 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452807126940_0001_01_000005 is : 143
2016-01-14 21:32:33,584 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/keyvalue/_temporary
2016-01-14 21:32:33,586 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] completed in: 00:20.410, using cpu time: 00:08.020
2016-01-14 21:32:33,586 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] completed flow: keyvalue
2016-01-14 21:32:33,587 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] starting flow: value
2016-01-14 21:32:33,587 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] at least one sink is marked for delete
2016-01-14 21:32:33,587 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-01-14 21:32:33,587 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] starting flow: key
2016-01-14 21:32:33,588 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] at least one sink is marked for delete
2016-01-14 21:32:33,588 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-01-14 21:32:33,597 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] starting
2016-01-14 21:32:33,597 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] starting
2016-01-14 21:32:33,598 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] source: Hfs["WritableSequenceFile[['offset', 'line']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/keyvalue"]
2016-01-14 21:32:33,598 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] sink: Hfs["WritableSequenceFile[['offset']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/key"]
2016-01-14 21:32:33,598 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] parallel execution of steps is enabled: true
2016-01-14 21:32:33,599 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] executing total steps: 1
2016-01-14 21:32:33,599 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] allocating management threads: 1
2016-01-14 21:32:33,598 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] source: Hfs["WritableSequenceFile[['offset', 'line']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/keyvalue"]
2016-01-14 21:32:33,600 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] starting step: (1/1) ...platform/testWritable/key
2016-01-14 21:32:33,600 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] sink: Hfs["WritableSequenceFile[['line']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/value"]
2016-01-14 21:32:33,600 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] parallel execution of steps is enabled: true
2016-01-14 21:32:33,601 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] executing total steps: 1
2016-01-14 21:32:33,601 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] allocating management threads: 1
2016-01-14 21:32:33,604 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] starting step: (1/1) ...atform/testWritable/value
2016-01-14 21:32:33,851 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] submitted hadoop job: job_1452807126940_0002
2016-01-14 21:32:33,851 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] tracking url: http://ip-10-167-78-165:53004/proxy/application_1452807126940_0002/
2016-01-14 21:32:33,866 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] submitted hadoop job: job_1452807126940_0003
2016-01-14 21:32:33,866 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] tracking url: http://ip-10-167-78-165:53004/proxy/application_1452807126940_0003/
2016-01-14 21:32:52,798 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452807126940_0002_01_000002 is : 143
2016-01-14 21:32:53,202 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452807126940_0002_01_000003 is : 143
2016-01-14 21:32:54,222 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452807126940_0002_01_000005 is : 143
2016-01-14 21:32:54,523 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452807126940_0002_01_000004 is : 143
2016-01-14 21:32:56,105 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/key/_temporary
2016-01-14 21:32:56,143 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] completed in: 00:22.506, using cpu time: 00:05.560
2016-01-14 21:32:56,143 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] completed flow: key
2016-01-14 21:33:04,378 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452807126940_0003_01_000002 is : 143
2016-01-14 21:33:04,599 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452807126940_0003_01_000003 is : 143
2016-01-14 21:33:04,708 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452807126940_0003_01_000005 is : 143
2016-01-14 21:33:04,742 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452807126940_0003_01_000004 is : 143
2016-01-14 21:33:05,986 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/value/_temporary
2016-01-14 21:33:05,987 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] completed in: 00:32.387, using cpu time: 00:05.730
2016-01-14 21:33:05,987 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] completed flow: value
2016-01-14 21:33:06,102 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output//hadoop2-mr1/writablesequencefileplatform/testWritable/value
2016-01-14 21:33:06,114 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output//hadoop2-mr1/writablesequencefileplatform/testWritable/key
2016-01-14 21:33:06,126 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output//hadoop2-mr1/writablesequencefileplatform/testWritable/keyvalue