Class cascading.tap.hadoop.HadoopMR1TapPlatformTest

2016-01-14 21:50:53,438 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(195)) - found 1 test platforms from classpath
2016-01-14 21:50:53,457 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(244)) - adding test: cascading.tap.hadoop.HadoopMR1TapPlatformTest, with platform: hadoop2-mr1
2016-01-14 21:50:53,490 INFO  hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(136)) - using cluster
2016-01-14 21:50:54,351 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
2016-01-14 21:50:54,972 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2016-01-14 21:50:55,500 WARN  server.AuthenticationFilter (AuthenticationFilter.java:init(162)) - 'signature.secret' configuration not set, using a random value as secret
2016-01-14 21:50:58,524 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-14 21:50:58,671 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-14 21:50:58,789 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-14 21:50:58,903 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-14 21:51:15,977 INFO  platform.TestPlatform (TestPlatform.java:getGlobalProperties(73)) - platform property overrides: 
2016-01-14 21:51:16,235 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 21:51:16,236 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 21:51:16,306 INFO  property.AppProps (AppProps.java:getAppID(177)) - using app.id: A87A10CE2FFD4B10BCFB677F761737E3
2016-01-14 21:51:16,408 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.067
2016-01-14 21:51:16,410 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 21:51:16,412 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 21:51:16,521 INFO  util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.0.4
2016-01-14 21:51:16,523 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition] starting
2016-01-14 21:51:16,524 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition]  source: Hfs["TextDelimited[['number', 'lower']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/classes/test/data/lower.txt"]
2016-01-14 21:51:16,524 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition]  sink: PartitionTap["Hfs["TextDelimited[['lower']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/hadoopmr1tapplatform/testCombinedPartitionTap/combinedpartition/partitioned"]"]["cascading.tap.partition.DelimitedPartition@51f4c07"]
2016-01-14 21:51:16,527 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition]  parallel execution of steps is enabled: true
2016-01-14 21:51:16,527 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition]  executing total steps: 1
2016-01-14 21:51:16,527 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition]  allocating management threads: 1
2016-01-14 21:51:16,529 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition] starting step: (1/1) ...inedpartition/partitioned
2016-01-14 21:51:17,414 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition] submitted hadoop job: job_1452808270475_0001
2016-01-14 21:51:17,417 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition] tracking url: http://ip-10-167-78-165:45852/proxy/application_1452808270475_0001/
2016-01-14 21:51:37,063 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452808270475_0001_01_000003 is : 143
2016-01-14 21:51:37,193 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452808270475_0001_01_000005 is : 143
2016-01-14 21:51:37,426 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452808270475_0001_01_000002 is : 143
2016-01-14 21:51:37,610 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452808270475_0001_01_000004 is : 143
2016-01-14 21:51:38,944 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/hadoopmr1tapplatform/testCombinedPartitionTap/combinedpartition/partitioned/_temporary
2016-01-14 21:51:38,948 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition]  completed in: 00:22.414, using cpu time: 00:07.010
2016-01-14 21:51:38,964 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-14 21:51:38,965 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-14 21:51:39,005 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.034
2016-01-14 21:51:39,009 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-14 21:51:39,009 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-14 21:51:39,032 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy] starting
2016-01-14 21:51:39,032 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy]  source: PartitionTap["Hfs["TextDelimited[['lower']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/hadoopmr1tapplatform/testCombinedPartitionTap/combinedpartition/partitioned"]"]["cascading.tap.partition.DelimitedPartition@51f4c07"]
2016-01-14 21:51:39,032 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy]  sink: Hfs["TextDelimited[['number', 'lower']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/hadoopmr1tapplatform/testCombinedPartitionTap/combinedpartition/final"]
2016-01-14 21:51:39,033 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy]  parallel execution of steps is enabled: true
2016-01-14 21:51:39,033 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy]  executing total steps: 1
2016-01-14 21:51:39,033 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy]  allocating management threads: 1
2016-01-14 21:51:39,034 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy] starting step: (1/1) ...p/combinedpartition/final
2016-01-14 21:51:39,230 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy] submitted hadoop job: job_1452808270475_0002
2016-01-14 21:51:39,230 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy] tracking url: http://ip-10-167-78-165:45852/proxy/application_1452808270475_0002/
2016-01-14 21:51:50,139 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452808270475_0002_01_000002 is : 143
2016-01-14 21:51:51,398 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output/hadoop2-mr1/hadoopmr1tapplatform/testCombinedPartitionTap/combinedpartition/final/_temporary
2016-01-14 21:51:51,400 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy]  completed in: 00:12.359, using cpu time: 00:01.170
2016-01-14 21:51:51,450 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output//hadoop2-mr1/hadoopmr1tapplatform/testCombinedPartitionTap/combinedpartition/partitioned
2016-01-14 21:51:51,476 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.4.x/build/test/output//hadoop2-mr1/hadoopmr1tapplatform/testCombinedPartitionTap/combinedpartition/final

Jan 14, 2016 9:51:10 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class
Jan 14, 2016 9:51:10 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class
Jan 14, 2016 9:51:10 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Jan 14, 2016 9:51:10 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Jan 14, 2016 9:51:10 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Jan 14, 2016 9:51:11 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Jan 14, 2016 9:51:11 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest"
Jan 14, 2016 9:51:11 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Jan 14, 2016 9:51:12 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class
Jan 14, 2016 9:51:12 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class
Jan 14, 2016 9:51:12 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Jan 14, 2016 9:51:12 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Jan 14, 2016 9:51:12 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Jan 14, 2016 9:51:12 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Jan 14, 2016 9:51:12 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Jan 14, 2016 9:51:12 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Jan 14, 2016 9:51:13 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
Jan 14, 2016 9:51:13 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Jan 14, 2016 9:51:13 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
Jan 14, 2016 9:51:13 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Jan 14, 2016 9:51:13 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Jan 14, 2016 9:51:13 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Jan 14, 2016 9:51:13 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Jan 14, 2016 9:51:13 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Jan 14, 2016 9:51:14 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
Jan 14, 2016 9:51:14 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Jan 14, 2016 9:51:14 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
Jan 14, 2016 9:51:14 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Jan 14, 2016 9:51:14 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Jan 14, 2016 9:51:14 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Jan 14, 2016 9:51:14 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Jan 14, 2016 9:51:14 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Jan 14, 2016 9:51:15 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
Jan 14, 2016 9:51:15 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Jan 14, 2016 9:51:15 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
Jan 14, 2016 9:51:15 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Jan 14, 2016 9:51:15 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Jan 14, 2016 9:51:15 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Jan 14, 2016 9:51:15 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Jan 14, 2016 9:51:15 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.