2016-05-18 03:14:09,066 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(197)) - found 1 test platforms from classpath
2016-05-18 03:14:09,085 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(246)) - adding test: cascading.scheme.hadoop.WritableSequenceFilePlatformTest, with platform: hadoop2-mr1
2016-05-18 03:14:09,110 INFO hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(136)) - using cluster
2016-05-18 03:14:09,926 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
2016-05-18 03:14:10,522 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2016-05-18 03:14:11,160 WARN server.AuthenticationFilter (AuthenticationFilter.java:init(162)) - 'signature.secret' configuration not set, using a random value as secret
2016-05-18 03:14:14,096 WARN containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-05-18 03:14:14,244 WARN containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-05-18 03:14:14,356 WARN containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-05-18 03:14:14,474 WARN containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-05-18 03:14:31,548 INFO platform.TestPlatform (TestPlatform.java:getGlobalProperties(75)) - platform property overrides:
2016-05-18 03:14:31,745 INFO util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 03:14:31,746 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(176)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.1.0/fdadb6ac788ea19f3412b9569a43a7635318b0c5/cascading-hadoop2-mr1-3.1.0.jar
2016-05-18 03:14:31,811 INFO property.AppProps (AppProps.java:getAppID(177)) - using app.id: 74D2E5BD35B04EC88BDF0174B1ADA082
2016-05-18 03:14:31,929 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.079
2016-05-18 03:14:31,931 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-18 03:14:31,933 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 03:14:32,041 INFO util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 03:14:32,041 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(176)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.1.0/fdadb6ac788ea19f3412b9569a43a7635318b0c5/cascading-hadoop2-mr1-3.1.0.jar
2016-05-18 03:14:32,086 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.038
2016-05-18 03:14:32,088 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-18 03:14:32,088 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 03:14:32,115 INFO util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 03:14:32,115 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(176)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.1.0/fdadb6ac788ea19f3412b9569a43a7635318b0c5/cascading-hadoop2-mr1-3.1.0.jar
2016-05-18 03:14:32,151 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.029
2016-05-18 03:14:32,152 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-18 03:14:32,153 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 03:14:32,173 INFO util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.1.0
2016-05-18 03:14:32,174 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] starting
2016-05-18 03:14:32,180 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] parallel execution of flows is enabled: true
2016-05-18 03:14:32,180 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] executing total flows: 3
2016-05-18 03:14:32,181 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] allocating management threads: 3
2016-05-18 03:14:32,182 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] starting flow: keyvalue
2016-05-18 03:14:32,183 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] at least one sink is marked for delete
2016-05-18 03:14:32,183 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-05-18 03:14:32,208 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] starting
2016-05-18 03:14:32,208 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.4.x/build/classes/test/data/apache.10.txt"]
2016-05-18 03:14:32,208 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] sink: Hfs["WritableSequenceFile[['offset', 'line']]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.4.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/keyvalue"]
2016-05-18 03:14:32,209 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] parallel execution of steps is enabled: true
2016-05-18 03:14:32,209 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] executing total steps: 1
2016-05-18 03:14:32,209 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] allocating management threads: 1
2016-05-18 03:14:32,210 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] starting step: (1/1) ...orm/testWritable/keyvalue
2016-05-18 03:14:33,092 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] submitted hadoop job: job_1463541266046_0001
2016-05-18 03:14:33,092 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] tracking url: http://ip-10-158-37-203:47997/proxy/application_1463541266046_0001/
2016-05-18 03:14:49,581 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463541266046_0001_01_000003 is : 143
2016-05-18 03:14:49,726 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463541266046_0001_01_000002 is : 143
2016-05-18 03:14:50,144 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463541266046_0001_01_000005 is : 143
2016-05-18 03:14:50,308 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463541266046_0001_01_000004 is : 143
2016-05-18 03:14:51,660 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.4.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/keyvalue/_temporary
2016-05-18 03:14:51,662 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] completed in: 00:19.448, using cpu time: 00:08.150
2016-05-18 03:14:51,662 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] completed flow: keyvalue
2016-05-18 03:14:51,662 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] starting flow: value
2016-05-18 03:14:51,662 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] starting flow: key
2016-05-18 03:14:51,663 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] at least one sink is marked for delete
2016-05-18 03:14:51,663 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] at least one sink is marked for delete
2016-05-18 03:14:51,663 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-05-18 03:14:51,663 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-05-18 03:14:51,672 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] starting
2016-05-18 03:14:51,674 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] source: Hfs["WritableSequenceFile[['offset', 'line']]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.4.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/keyvalue"]
2016-05-18 03:14:51,675 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] sink: Hfs["WritableSequenceFile[['offset']]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.4.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/key"]
2016-05-18 03:14:51,676 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] parallel execution of steps is enabled: true
2016-05-18 03:14:51,676 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] executing total steps: 1
2016-05-18 03:14:51,677 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] allocating management threads: 1
2016-05-18 03:14:51,676 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] starting
2016-05-18 03:14:51,679 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] source: Hfs["WritableSequenceFile[['offset', 'line']]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.4.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/keyvalue"]
2016-05-18 03:14:51,680 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] starting step: (1/1) ...platform/testWritable/key
2016-05-18 03:14:51,680 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] sink: Hfs["WritableSequenceFile[['line']]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.4.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/value"]
2016-05-18 03:14:51,680 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] parallel execution of steps is enabled: true
2016-05-18 03:14:51,681 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] executing total steps: 1
2016-05-18 03:14:51,681 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] allocating management threads: 1
2016-05-18 03:14:51,683 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] starting step: (1/1) ...atform/testWritable/value
2016-05-18 03:14:51,937 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] submitted hadoop job: job_1463541266046_0002
2016-05-18 03:14:51,937 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] tracking url: http://ip-10-158-37-203:47997/proxy/application_1463541266046_0002/
2016-05-18 03:14:51,946 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] submitted hadoop job: job_1463541266046_0003
2016-05-18 03:14:51,947 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] tracking url: http://ip-10-158-37-203:47997/proxy/application_1463541266046_0003/
2016-05-18 03:15:11,802 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463541266046_0002_01_000002 is : 143
2016-05-18 03:15:12,227 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463541266046_0002_01_000004 is : 143
2016-05-18 03:15:12,517 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463541266046_0002_01_000005 is : 143
2016-05-18 03:15:12,614 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463541266046_0002_01_000003 is : 143
2016-05-18 03:15:14,063 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.4.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/value/_temporary
2016-05-18 03:15:14,066 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] completed in: 00:22.375, using cpu time: 00:05.910
2016-05-18 03:15:14,066 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] completed flow: value
2016-05-18 03:15:22,342 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463541266046_0003_01_000005 is : 143
2016-05-18 03:15:22,440 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463541266046_0003_01_000004 is : 143
2016-05-18 03:15:22,723 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463541266046_0003_01_000003 is : 143
2016-05-18 03:15:23,025 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463541266046_0003_01_000002 is : 143
2016-05-18 03:15:24,271 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.4.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/key/_temporary
2016-05-18 03:15:24,272 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] completed in: 00:32.597, using cpu time: 00:05.540
2016-05-18 03:15:24,273 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] completed flow: key
2016-05-18 03:15:24,406 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.4.x/build/test/output//hadoop2-mr1/writablesequencefileplatform/testWritable/keyvalue
2016-05-18 03:15:24,419 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.4.x/build/test/output//hadoop2-mr1/writablesequencefileplatform/testWritable/key
2016-05-18 03:15:24,431 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.4.x/build/test/output//hadoop2-mr1/writablesequencefileplatform/testWritable/value