Class cascading.tap.hadoop.HadoopMR1TapPlatformTest

2

tests

0

failures

0

ignored

56.997s

duration

100%

successful

Tests

Test Duration Result
testCombinedHfs 23.041s passed
testCombinedPartitionTap 33.956s passed

Standard output

2016-01-15 00:09:59,727 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(195)) - found 1 test platforms from classpath
2016-01-15 00:09:59,748 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(244)) - adding test: cascading.tap.hadoop.HadoopMR1TapPlatformTest, with platform: hadoop2-mr1
2016-01-15 00:09:59,775 INFO  hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(136)) - using cluster
2016-01-15 00:10:00,651 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
2016-01-15 00:10:01,324 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2016-01-15 00:10:01,859 WARN  server.AuthenticationFilter (AuthenticationFilter.java:init(166)) - 'signature.secret' configuration not set, using a random value as secret
2016-01-15 00:10:05,035 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-15 00:10:05,204 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-15 00:10:05,321 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-15 00:10:05,438 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-01-15 00:10:17,264 WARN  server.AuthenticationFilter (AuthenticationFilter.java:init(166)) - 'signature.secret' configuration not set, using a random value as secret
2016-01-15 00:10:18,206 WARN  server.AuthenticationFilter (AuthenticationFilter.java:init(166)) - 'signature.secret' configuration not set, using a random value as secret
2016-01-15 00:10:18,207 WARN  server.AuthenticationFilter (AuthenticationFilter.java:init(166)) - 'signature.secret' configuration not set, using a random value as secret
2016-01-15 00:10:22,551 INFO  platform.TestPlatform (TestPlatform.java:getGlobalProperties(73)) - platform property overrides: 
2016-01-15 00:10:22,848 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 00:10:22,849 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 00:10:22,920 INFO  property.AppProps (AppProps.java:getAppID(177)) - using app.id: 8C2960050EBD422CA5FE5F545844B57B
2016-01-15 00:10:23,019 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.066
2016-01-15 00:10:23,021 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 00:10:23,022 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 00:10:23,134 INFO  util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.0.4
2016-01-15 00:10:23,134 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition] starting
2016-01-15 00:10:23,135 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition]  source: Hfs["TextDelimited[['number', 'lower']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/classes/test/data/lower.txt"]
2016-01-15 00:10:23,135 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition]  sink: PartitionTap["Hfs["TextDelimited[['lower']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/hadoopmr1tapplatform/testCombinedPartitionTap/combinedpartition/partitioned"]"]["cascading.tap.partition.DelimitedPartition@7e8c24b0"]
2016-01-15 00:10:23,136 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition]  parallel execution of steps is enabled: true
2016-01-15 00:10:23,136 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition]  executing total steps: 1
2016-01-15 00:10:23,136 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition]  allocating management threads: 1
2016-01-15 00:10:23,137 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition] starting step: (1/1) ...inedpartition/partitioned
2016-01-15 00:10:24,082 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition] submitted hadoop job: job_1452816617049_0001
2016-01-15 00:10:24,082 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition] tracking url: http://ip-10-167-78-165:57949/proxy/application_1452816617049_0001/
2016-01-15 00:10:42,911 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452816617049_0001_01_000002 is : 143
2016-01-15 00:10:42,997 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452816617049_0001_01_000006 is : 143
2016-01-15 00:10:43,134 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452816617049_0001_01_000004 is : 143
2016-01-15 00:10:43,296 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452816617049_0001_01_000005 is : 143
2016-01-15 00:10:44,572 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/hadoopmr1tapplatform/testCombinedPartitionTap/combinedpartition/partitioned/_temporary
2016-01-15 00:10:44,576 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition]  completed in: 00:21.427, using cpu time: 00:05.320
2016-01-15 00:10:44,592 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2016-01-15 00:10:44,593 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.4/6099926be810c2c62f4bd24f369d52cdd84cf31d/cascading-hadoop2-mr1-3.0.4.jar
2016-01-15 00:10:44,636 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.036
2016-01-15 00:10:44,637 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-01-15 00:10:44,638 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-01-15 00:10:44,666 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy] starting
2016-01-15 00:10:44,667 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy]  source: PartitionTap["Hfs["TextDelimited[['lower']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/hadoopmr1tapplatform/testCombinedPartitionTap/combinedpartition/partitioned"]"]["cascading.tap.partition.DelimitedPartition@7e8c24b0"]
2016-01-15 00:10:44,667 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy]  sink: Hfs["TextDelimited[['number', 'lower']]"]["/opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/hadoopmr1tapplatform/testCombinedPartitionTap/combinedpartition/final"]
2016-01-15 00:10:44,668 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy]  parallel execution of steps is enabled: true
2016-01-15 00:10:44,669 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy]  executing total steps: 1
2016-01-15 00:10:44,669 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy]  allocating management threads: 1
2016-01-15 00:10:44,670 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy] starting step: (1/1) ...p/combinedpartition/final
2016-01-15 00:10:44,865 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy] submitted hadoop job: job_1452816617049_0002
2016-01-15 00:10:44,865 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy] tracking url: http://ip-10-167-78-165:57949/proxy/application_1452816617049_0002/
2016-01-15 00:10:55,449 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1452816617049_0002_01_000002 is : 143
2016-01-15 00:10:56,700 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output/hadoop2-mr1/hadoopmr1tapplatform/testCombinedPartitionTap/combinedpartition/final/_temporary
2016-01-15 00:10:56,702 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy]  completed in: 00:12.029, using cpu time: 00:00.830
2016-01-15 00:10:56,728 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output//hadoop2-mr1/hadoopmr1tapplatform/testCombinedPartitionTap/combinedpartition/partitioned
2016-01-15 00:10:56,758 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/aa7cf7440ab7c2d9/apache-2.5.x/build/test/output//hadoop2-mr1/hadoopmr1tapplatform/testCombinedPartitionTap/combinedpartition/final

Standard error

Jan 15, 2016 12:10:17 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class
Jan 15, 2016 12:10:17 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class
Jan 15, 2016 12:10:17 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Jan 15, 2016 12:10:17 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Jan 15, 2016 12:10:17 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Jan 15, 2016 12:10:17 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Jan 15, 2016 12:10:18 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest"
Jan 15, 2016 12:10:18 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Jan 15, 2016 12:10:18 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class
Jan 15, 2016 12:10:18 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class
Jan 15, 2016 12:10:18 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Jan 15, 2016 12:10:18 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Jan 15, 2016 12:10:18 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Jan 15, 2016 12:10:18 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Jan 15, 2016 12:10:19 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Jan 15, 2016 12:10:19 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Jan 15, 2016 12:10:19 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
Jan 15, 2016 12:10:19 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Jan 15, 2016 12:10:19 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
Jan 15, 2016 12:10:19 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Jan 15, 2016 12:10:19 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Jan 15, 2016 12:10:19 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Jan 15, 2016 12:10:19 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Jan 15, 2016 12:10:19 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Jan 15, 2016 12:10:20 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
Jan 15, 2016 12:10:20 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Jan 15, 2016 12:10:20 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
Jan 15, 2016 12:10:20 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Jan 15, 2016 12:10:20 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Jan 15, 2016 12:10:20 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Jan 15, 2016 12:10:20 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Jan 15, 2016 12:10:20 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Jan 15, 2016 12:10:21 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
Jan 15, 2016 12:10:21 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Jan 15, 2016 12:10:21 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
Jan 15, 2016 12:10:21 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Jan 15, 2016 12:10:21 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Jan 15, 2016 12:10:21 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Jan 15, 2016 12:10:21 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Jan 15, 2016 12:10:21 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.