2016-05-18 08:36:52,335 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(197)) - found 1 test platforms from classpath
2016-05-18 08:36:52,354 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(246)) - adding test: cascading.scheme.hadoop.WritableSequenceFilePlatformTest, with platform: hadoop2-mr1
2016-05-18 08:36:52,386 INFO hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(136)) - using cluster
2016-05-18 08:36:53,430 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
2016-05-18 08:36:54,134 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2016-05-18 08:36:58,466 WARN containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-05-18 08:36:58,673 WARN containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-05-18 08:36:58,838 WARN containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-05-18 08:36:59,006 WARN containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-05-18 08:37:16,097 INFO platform.TestPlatform (TestPlatform.java:getGlobalProperties(75)) - platform property overrides:
2016-05-18 08:37:16,300 INFO util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 08:37:16,301 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(176)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.1.0/fdadb6ac788ea19f3412b9569a43a7635318b0c5/cascading-hadoop2-mr1-3.1.0.jar
2016-05-18 08:37:16,369 INFO property.AppProps (AppProps.java:getAppID(177)) - using app.id: CA6EA53582044C169136ED6C14F5C38C
2016-05-18 08:37:16,508 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.096
2016-05-18 08:37:16,512 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-18 08:37:16,512 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 08:37:16,624 INFO util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 08:37:16,625 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(176)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.1.0/fdadb6ac788ea19f3412b9569a43a7635318b0c5/cascading-hadoop2-mr1-3.1.0.jar
2016-05-18 08:37:16,667 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.035
2016-05-18 08:37:16,669 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-18 08:37:16,669 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 08:37:16,697 INFO util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 08:37:16,697 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(176)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.1.0/fdadb6ac788ea19f3412b9569a43a7635318b0c5/cascading-hadoop2-mr1-3.1.0.jar
2016-05-18 08:37:16,732 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.028
2016-05-18 08:37:16,734 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-18 08:37:16,734 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 08:37:16,757 INFO util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.1.0
2016-05-18 08:37:16,757 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] starting
2016-05-18 08:37:16,761 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] parallel execution of flows is enabled: true
2016-05-18 08:37:16,761 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] executing total flows: 3
2016-05-18 08:37:16,761 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] allocating management threads: 3
2016-05-18 08:37:16,762 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] starting flow: keyvalue
2016-05-18 08:37:16,763 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] at least one sink is marked for delete
2016-05-18 08:37:16,763 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-05-18 08:37:16,784 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] starting
2016-05-18 08:37:16,785 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.6.x/build/classes/test/data/apache.10.txt"]
2016-05-18 08:37:16,785 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] sink: Hfs["WritableSequenceFile[['offset', 'line']]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.6.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/keyvalue"]
2016-05-18 08:37:16,785 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] parallel execution of steps is enabled: true
2016-05-18 08:37:16,786 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] executing total steps: 1
2016-05-18 08:37:16,786 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] allocating management threads: 1
2016-05-18 08:37:16,787 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] starting step: (1/1) ...orm/testWritable/keyvalue
2016-05-18 08:37:17,500 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] submitted hadoop job: job_1463560630596_0001
2016-05-18 08:37:17,501 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] tracking url: http://ip-10-158-37-203:43389/proxy/application_1463560630596_0001/
2016-05-18 08:37:35,991 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463560630596_0001_01_000002 is : 143
2016-05-18 08:37:36,039 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463560630596_0001_01_000004 is : 143
2016-05-18 08:37:36,382 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463560630596_0001_01_000005 is : 143
2016-05-18 08:37:37,187 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463560630596_0001_01_000003 is : 143
2016-05-18 08:37:38,453 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.6.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/keyvalue/_temporary
2016-05-18 08:37:38,455 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] completed in: 00:21.665, using cpu time: 00:07.030
2016-05-18 08:37:38,455 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] completed flow: keyvalue
2016-05-18 08:37:38,455 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] starting flow: value
2016-05-18 08:37:38,456 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] starting flow: key
2016-05-18 08:37:38,456 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] at least one sink is marked for delete
2016-05-18 08:37:38,457 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-05-18 08:37:38,456 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] at least one sink is marked for delete
2016-05-18 08:37:38,457 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-05-18 08:37:38,466 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] starting
2016-05-18 08:37:38,466 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] source: Hfs["WritableSequenceFile[['offset', 'line']]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.6.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/keyvalue"]
2016-05-18 08:37:38,467 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] sink: Hfs["WritableSequenceFile[['line']]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.6.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/value"]
2016-05-18 08:37:38,467 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] parallel execution of steps is enabled: true
2016-05-18 08:37:38,469 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] starting
2016-05-18 08:37:38,469 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] source: Hfs["WritableSequenceFile[['offset', 'line']]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.6.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/keyvalue"]
2016-05-18 08:37:38,469 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] sink: Hfs["WritableSequenceFile[['offset']]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.6.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/key"]
2016-05-18 08:37:38,469 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] parallel execution of steps is enabled: true
2016-05-18 08:37:38,470 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] executing total steps: 1
2016-05-18 08:37:38,470 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] allocating management threads: 1
2016-05-18 08:37:38,469 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] executing total steps: 1
2016-05-18 08:37:38,470 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] allocating management threads: 1
2016-05-18 08:37:38,471 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] starting step: (1/1) ...platform/testWritable/key
2016-05-18 08:37:38,473 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] starting step: (1/1) ...atform/testWritable/value
2016-05-18 08:37:38,678 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] submitted hadoop job: job_1463560630596_0002
2016-05-18 08:37:38,678 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] tracking url: http://ip-10-158-37-203:43389/proxy/application_1463560630596_0002/
2016-05-18 08:37:38,715 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] submitted hadoop job: job_1463560630596_0003
2016-05-18 08:37:38,715 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] tracking url: http://ip-10-158-37-203:43389/proxy/application_1463560630596_0003/
2016-05-18 08:38:01,204 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463560630596_0002_01_000003 is : 143
2016-05-18 08:38:01,313 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463560630596_0002_01_000004 is : 143
2016-05-18 08:38:01,508 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463560630596_0002_01_000005 is : 143
2016-05-18 08:38:02,705 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.6.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/key/_temporary
2016-05-18 08:38:02,707 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] completed in: 00:24.234, using cpu time: 00:04.490
2016-05-18 08:38:02,708 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] completed flow: key
2016-05-18 08:38:25,482 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463560630596_0003_01_000003 is : 143
2016-05-18 08:38:25,982 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463560630596_0003_01_000002 is : 143
2016-05-18 08:38:26,076 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463560630596_0003_01_000005 is : 143
2016-05-18 08:38:26,125 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463560630596_0003_01_000004 is : 143
2016-05-18 08:38:27,328 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.6.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/value/_temporary
2016-05-18 08:38:27,330 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] completed in: 00:48.860, using cpu time: 00:04.570
2016-05-18 08:38:27,330 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] completed flow: value
2016-05-18 08:38:27,452 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.6.x/build/test/output//hadoop2-mr1/writablesequencefileplatform/testWritable/keyvalue
2016-05-18 08:38:27,467 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.6.x/build/test/output//hadoop2-mr1/writablesequencefileplatform/testWritable/key
2016-05-18 08:38:27,482 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.6.x/build/test/output//hadoop2-mr1/writablesequencefileplatform/testWritable/value