2016-05-18 00:47:41,081 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(197)) - found 1 test platforms from classpath
2016-05-18 00:47:41,107 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(246)) - adding test: cascading.scheme.hadoop.WritableSequenceFilePlatformTest, with platform: hadoop2-mr1
2016-05-18 00:47:41,136 INFO hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(136)) - using cluster
2016-05-18 00:47:41,984 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
2016-05-18 00:47:42,515 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2016-05-18 00:47:43,080 WARN server.AuthenticationFilter (AuthenticationFilter.java:init(158)) - 'signature.secret' configuration not set, using a random value as secret
2016-05-18 00:47:45,982 WARN containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-05-18 00:47:46,123 WARN containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-05-18 00:47:46,238 WARN containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-05-18 00:47:46,352 WARN containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-05-18 00:48:03,431 INFO platform.TestPlatform (TestPlatform.java:getGlobalProperties(75)) - platform property overrides:
2016-05-18 00:48:03,630 INFO util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 00:48:03,631 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(176)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.1.0/fdadb6ac788ea19f3412b9569a43a7635318b0c5/cascading-hadoop2-mr1-3.1.0.jar
2016-05-18 00:48:03,702 INFO property.AppProps (AppProps.java:getAppID(177)) - using app.id: 94E2894A604B45A0ACA987B1C3F973EE
2016-05-18 00:48:03,818 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.075
2016-05-18 00:48:03,820 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-18 00:48:03,822 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 00:48:03,943 INFO util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 00:48:03,944 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(176)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.1.0/fdadb6ac788ea19f3412b9569a43a7635318b0c5/cascading-hadoop2-mr1-3.1.0.jar
2016-05-18 00:48:03,986 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.034
2016-05-18 00:48:03,988 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-18 00:48:03,988 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 00:48:04,014 INFO util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 00:48:04,015 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(176)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.1.0/fdadb6ac788ea19f3412b9569a43a7635318b0c5/cascading-hadoop2-mr1-3.1.0.jar
2016-05-18 00:48:04,049 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.028
2016-05-18 00:48:04,051 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-18 00:48:04,051 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 00:48:04,071 INFO util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.1.0
2016-05-18 00:48:04,071 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] starting
2016-05-18 00:48:04,075 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] parallel execution of flows is enabled: true
2016-05-18 00:48:04,076 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] executing total flows: 3
2016-05-18 00:48:04,076 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] allocating management threads: 3
2016-05-18 00:48:04,077 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] starting flow: keyvalue
2016-05-18 00:48:04,079 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] at least one sink is marked for delete
2016-05-18 00:48:04,079 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-05-18 00:48:04,113 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] starting
2016-05-18 00:48:04,113 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.3.x/build/classes/test/data/apache.10.txt"]
2016-05-18 00:48:04,114 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] sink: Hfs["WritableSequenceFile[['offset', 'line']]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.3.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/keyvalue"]
2016-05-18 00:48:04,114 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] parallel execution of steps is enabled: true
2016-05-18 00:48:04,114 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] executing total steps: 1
2016-05-18 00:48:04,114 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] allocating management threads: 1
2016-05-18 00:48:04,117 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] starting step: (1/1) ...orm/testWritable/keyvalue
2016-05-18 00:48:04,834 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] submitted hadoop job: job_1463532477929_0001
2016-05-18 00:48:04,835 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] tracking url: http://ip-10-158-37-203.ec2.internal:58329/proxy/application_1463532477929_0001/
2016-05-18 00:48:21,718 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463532477929_0001_01_000002 is : 143
2016-05-18 00:48:21,932 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463532477929_0001_01_000005 is : 143
2016-05-18 00:48:22,689 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463532477929_0001_01_000003 is : 143
2016-05-18 00:48:24,024 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.3.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/keyvalue/_temporary
2016-05-18 00:48:24,026 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [keyvalue] completed in: 00:19.905, using cpu time: 00:06.310
2016-05-18 00:48:24,026 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] completed flow: keyvalue
2016-05-18 00:48:24,026 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] starting flow: value
2016-05-18 00:48:24,026 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] starting flow: key
2016-05-18 00:48:24,027 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] at least one sink is marked for delete
2016-05-18 00:48:24,027 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] at least one sink is marked for delete
2016-05-18 00:48:24,027 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-05-18 00:48:24,027 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2016-05-18 00:48:24,034 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] starting
2016-05-18 00:48:24,035 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] source: Hfs["WritableSequenceFile[['offset', 'line']]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.3.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/keyvalue"]
2016-05-18 00:48:24,035 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] starting
2016-05-18 00:48:24,036 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] source: Hfs["WritableSequenceFile[['offset', 'line']]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.3.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/keyvalue"]
2016-05-18 00:48:24,036 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] sink: Hfs["WritableSequenceFile[['offset']]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.3.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/key"]
2016-05-18 00:48:24,036 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] parallel execution of steps is enabled: true
2016-05-18 00:48:24,036 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] executing total steps: 1
2016-05-18 00:48:24,036 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] allocating management threads: 1
2016-05-18 00:48:24,036 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] sink: Hfs["WritableSequenceFile[['line']]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.3.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/value"]
2016-05-18 00:48:24,037 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] parallel execution of steps is enabled: true
2016-05-18 00:48:24,037 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] executing total steps: 1
2016-05-18 00:48:24,037 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] allocating management threads: 1
2016-05-18 00:48:24,039 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] starting step: (1/1) ...atform/testWritable/value
2016-05-18 00:48:24,039 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] starting step: (1/1) ...platform/testWritable/key
2016-05-18 00:48:24,517 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] submitted hadoop job: job_1463532477929_0002
2016-05-18 00:48:24,517 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] tracking url: http://ip-10-158-37-203.ec2.internal:58329/proxy/application_1463532477929_0002/
2016-05-18 00:48:24,708 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] submitted hadoop job: job_1463532477929_0003
2016-05-18 00:48:24,708 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] tracking url: http://ip-10-158-37-203.ec2.internal:58329/proxy/application_1463532477929_0003/
2016-05-18 00:48:42,672 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463532477929_0002_01_000002 is : 143
2016-05-18 00:48:43,647 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463532477929_0002_01_000003 is : 143
2016-05-18 00:48:43,722 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463532477929_0002_01_000004 is : 143
2016-05-18 00:48:43,780 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463532477929_0002_01_000005 is : 143
2016-05-18 00:48:45,325 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.3.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/value/_temporary
2016-05-18 00:48:45,329 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [value] completed in: 00:21.267, using cpu time: 00:04.050
2016-05-18 00:48:45,329 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] completed flow: value
2016-05-18 00:48:52,264 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463532477929_0003_01_000004 is : 143
2016-05-18 00:48:52,333 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463532477929_0003_01_000005 is : 143
2016-05-18 00:48:52,417 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463532477929_0003_01_000003 is : 143
2016-05-18 00:48:52,575 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463532477929_0003_01_000002 is : 143
2016-05-18 00:48:53,811 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.3.x/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/key/_temporary
2016-05-18 00:48:53,813 INFO flow.Flow (BaseFlow.java:logInfo(1504)) - [key] completed in: 00:29.775, using cpu time: 00:04.100
2016-05-18 00:48:53,813 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] completed flow: key
2016-05-18 00:48:53,923 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.3.x/build/test/output//hadoop2-mr1/writablesequencefileplatform/testWritable/value
2016-05-18 00:48:53,936 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.3.x/build/test/output//hadoop2-mr1/writablesequencefileplatform/testWritable/key
2016-05-18 00:48:53,948 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.3.x/build/test/output//hadoop2-mr1/writablesequencefileplatform/testWritable/keyvalue