Class cascading.tap.hadoop.HadoopMR1TapPlatformTest

2016-01-15 05:24:59,596 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(195)) - found 1 test platforms from classpath
2016-01-15 05:24:59,623 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(244)) - adding test: cascading.tap.hadoop.HadoopMR1TapPlatformTest, with platform: hadoop2-mr1
2016-01-15 05:24:59,656 INFO  hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(136)) - using cluster
2016-01-15 05:25:00,760 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
2016-01-15 05:25:01,407 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(125)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2016-01-15 05:25:05,843 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-15 05:25:06,065 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-15 05:25:06,246 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-15 05:25:06,432 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-15 05:25:23,543 INFO  platform.TestPlatform (TestPlatform.java:getGlobalProperties(73)) - platform property overrides: 
2016-01-15 05:25:23,816 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 05:25:23,817 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 05:25:23,885 INFO  property.AppProps (AppProps.java:getAppID(177)) - using app.id: 0B0335E457E0447D81876703FDACB561
2016-01-15 05:25:23,997 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.067
2016-01-15 05:25:24,000 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 05:25:24,000 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 05:25:24,119 INFO  util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.0.4
2016-01-15 05:25:24,120 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition] starting
2016-01-15 05:25:24,120 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition]  source: Hfs["TextDelimited[['number', 'lower']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/classes/test/data/lower.txt"]
2016-01-15 05:25:24,121 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition]  sink: PartitionTap["Hfs["TextDelimited[['lower']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/hadoopmr1tapplatform/testCombinedPartitionTap/combinedpartition/partitioned"]"]["cascading.tap.partition.DelimitedPartition@43469649"]
2016-01-15 05:25:24,122 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition]  parallel execution of steps is enabled: true
2016-01-15 05:25:24,122 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition]  executing total steps: 1
2016-01-15 05:25:24,122 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition]  allocating management threads: 1
2016-01-15 05:25:24,123 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition] starting step: (1/1) ...inedpartition/partitioned
2016-01-15 05:25:25,067 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition] submitted hadoop job: job_1452835518042_0001
2016-01-15 05:25:25,067 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition] tracking url: http://ip-10-167-78-165:46806/proxy/application_1452835518042_0001/
2016-01-15 05:25:43,662 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452835518042_0001_01_000006 is : 143
2016-01-15 05:25:45,418 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452835518042_0001_01_000003 is : 143
2016-01-15 05:25:45,785 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452835518042_0001_01_000005 is : 143
2016-01-15 05:25:45,832 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452835518042_0001_01_000004 is : 143
2016-01-15 05:25:47,087 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/hadoopmr1tapplatform/testCombinedPartitionTap/combinedpartition/partitioned/_temporary
2016-01-15 05:25:47,090 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition]  completed in: 00:22.961, using cpu time: 00:05.570
2016-01-15 05:25:47,109 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 05:25:47,110 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 05:25:47,152 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.036
2016-01-15 05:25:47,154 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 05:25:47,154 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 05:25:47,178 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy] starting
2016-01-15 05:25:47,178 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy]  source: PartitionTap["Hfs["TextDelimited[['lower']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/hadoopmr1tapplatform/testCombinedPartitionTap/combinedpartition/partitioned"]"]["cascading.tap.partition.DelimitedPartition@43469649"]
2016-01-15 05:25:47,178 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy]  sink: Hfs["TextDelimited[['number', 'lower']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/hadoopmr1tapplatform/testCombinedPartitionTap/combinedpartition/final"]
2016-01-15 05:25:47,179 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy]  parallel execution of steps is enabled: true
2016-01-15 05:25:47,179 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy]  executing total steps: 1
2016-01-15 05:25:47,179 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy]  allocating management threads: 1
2016-01-15 05:25:47,180 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy] starting step: (1/1) ...p/combinedpartition/final
2016-01-15 05:25:47,360 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy] submitted hadoop job: job_1452835518042_0002
2016-01-15 05:25:47,360 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy] tracking url: http://ip-10-167-78-165:46806/proxy/application_1452835518042_0002/
2016-01-15 05:26:04,148 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1452835518042_0002_01_000002 is : 143
2016-01-15 05:26:05,371 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output/hadoop2-mr1/hadoopmr1tapplatform/testCombinedPartitionTap/combinedpartition/final/_temporary
2016-01-15 05:26:05,375 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy]  completed in: 00:18.189, using cpu time: 00:00.830
2016-01-15 05:26:05,401 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/hadoopmr1tapplatform/testCombinedPartitionTap/combinedpartition/final
2016-01-15 05:26:05,409 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.7.x/build/test/output//hadoop2-mr1/hadoopmr1tapplatform/testCombinedPartitionTap/combinedpartition/partitioned

Jan 15, 2016 5:25:18 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class
Jan 15, 2016 5:25:18 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class
Jan 15, 2016 5:25:18 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Jan 15, 2016 5:25:18 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Jan 15, 2016 5:25:18 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Jan 15, 2016 5:25:18 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Jan 15, 2016 5:25:19 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest"
Jan 15, 2016 5:25:19 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Jan 15, 2016 5:25:19 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class
Jan 15, 2016 5:25:19 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class
Jan 15, 2016 5:25:19 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Jan 15, 2016 5:25:19 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Jan 15, 2016 5:25:19 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Jan 15, 2016 5:25:19 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Jan 15, 2016 5:25:20 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Jan 15, 2016 5:25:20 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Jan 15, 2016 5:25:20 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
Jan 15, 2016 5:25:20 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Jan 15, 2016 5:25:20 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
Jan 15, 2016 5:25:20 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Jan 15, 2016 5:25:20 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Jan 15, 2016 5:25:20 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Jan 15, 2016 5:25:20 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Jan 15, 2016 5:25:20 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Jan 15, 2016 5:25:21 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
Jan 15, 2016 5:25:21 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Jan 15, 2016 5:25:21 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
Jan 15, 2016 5:25:21 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Jan 15, 2016 5:25:21 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Jan 15, 2016 5:25:21 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Jan 15, 2016 5:25:21 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Jan 15, 2016 5:25:21 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Jan 15, 2016 5:25:22 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
Jan 15, 2016 5:25:22 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Jan 15, 2016 5:25:22 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
Jan 15, 2016 5:25:22 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Jan 15, 2016 5:25:22 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Jan 15, 2016 5:25:22 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Jan 15, 2016 5:25:22 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Jan 15, 2016 5:25:22 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.