Class cascading.tap.hadoop.HadoopMR1TapPlatformTest

2015-08-12 19:31:12,340 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(195)) - found 1 test platforms from classpath
2015-08-12 19:31:12,410 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(244)) - adding test: cascading.tap.hadoop.HadoopMR1TapPlatformTest, with platform: hadoop2-mr1
2015-08-12 19:31:12,474 INFO  hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(136)) - using cluster
2015-08-12 19:31:13,716 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
2015-08-12 19:31:14,601 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2015-08-12 19:31:21,986 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-08-12 19:31:22,266 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-08-12 19:31:22,570 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-08-12 19:31:22,923 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-08-12 19:31:40,156 INFO  platform.TestPlatform (TestPlatform.java:getGlobalProperties(73)) - platform property overrides: 
2015-08-12 19:31:40,672 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-08-12 19:31:40,676 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-08-12 19:31:40,815 INFO  property.AppProps (AppProps.java:getAppID(177)) - using app.id: B9683BFE861F4F0FBE2930006D15353D
2015-08-12 19:31:40,996 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.106
2015-08-12 19:31:41,000 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2015-08-12 19:31:41,002 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-08-12 19:31:41,178 INFO  util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.0.2
2015-08-12 19:31:41,187 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition] starting
2015-08-12 19:31:41,187 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition]  source: Hfs["TextDelimited[['number', 'lower']]"]["/home/cascading/cascading.compatibility/biginsights-4.0.x/build/classes/test/data/lower.txt"]
2015-08-12 19:31:41,188 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition]  sink: PartitionTap["Hfs["TextDelimited[['lower']]"]["/home/cascading/cascading.compatibility/biginsights-4.0.x/build/test/output/hadoop2-mr1/hadoopmr1tapplatform/testCombinedPartitionTap/combinedpartition/partitioned"]"]["cascading.tap.partition.DelimitedPartition@31ba8bb2"]
2015-08-12 19:31:41,189 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition]  parallel execution of steps is enabled: true
2015-08-12 19:31:41,189 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition]  executing total steps: 1
2015-08-12 19:31:41,190 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition]  allocating management threads: 1
2015-08-12 19:31:41,194 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition] starting step: (1/1) ...inedpartition/partitioned
2015-08-12 19:31:42,147 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition] submitted hadoop job: job_1439433094636_0001
2015-08-12 19:31:42,148 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition] tracking url: http://node1.bidemo.com:49910/proxy/application_1439433094636_0001/
2015-08-12 19:32:15,434 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1439433094636_0001_01_000006 is : 143
2015-08-12 19:32:17,314 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1439433094636_0001_01_000003 is : 143
2015-08-12 19:32:19,178 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /home/cascading/cascading.compatibility/biginsights-4.0.x/build/test/output/hadoop2-mr1/hadoopmr1tapplatform/testCombinedPartitionTap/combinedpartition/partitioned/_temporary
2015-08-12 19:32:19,188 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [partition]  completed in: 00:37.977, using cpu time: 00:05.710
2015-08-12 19:32:19,233 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-08-12 19:32:19,236 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-08-12 19:32:19,325 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.061
2015-08-12 19:32:19,327 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2015-08-12 19:32:19,328 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-08-12 19:32:19,409 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy] starting
2015-08-12 19:32:19,411 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy]  source: PartitionTap["Hfs["TextDelimited[['lower']]"]["/home/cascading/cascading.compatibility/biginsights-4.0.x/build/test/output/hadoop2-mr1/hadoopmr1tapplatform/testCombinedPartitionTap/combinedpartition/partitioned"]"]["cascading.tap.partition.DelimitedPartition@31ba8bb2"]
2015-08-12 19:32:19,412 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy]  sink: Hfs["TextDelimited[['number', 'lower']]"]["/home/cascading/cascading.compatibility/biginsights-4.0.x/build/test/output/hadoop2-mr1/hadoopmr1tapplatform/testCombinedPartitionTap/combinedpartition/final"]
2015-08-12 19:32:19,413 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy]  parallel execution of steps is enabled: true
2015-08-12 19:32:19,418 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy]  executing total steps: 1
2015-08-12 19:32:19,419 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy]  allocating management threads: 1
2015-08-12 19:32:19,437 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy] starting step: (1/1) ...p/combinedpartition/final
2015-08-12 19:32:19,854 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy] submitted hadoop job: job_1439433094636_0002
2015-08-12 19:32:19,854 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy] tracking url: http://node1.bidemo.com:49910/proxy/application_1439433094636_0002/
2015-08-12 19:32:34,655 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1439433094636_0002_01_000002 is : 143
2015-08-12 19:32:36,040 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /home/cascading/cascading.compatibility/biginsights-4.0.x/build/test/output/hadoop2-mr1/hadoopmr1tapplatform/testCombinedPartitionTap/combinedpartition/final/_temporary
2015-08-12 19:32:36,045 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [copy]  completed in: 00:16.628, using cpu time: 00:01.030
2015-08-12 19:32:36,095 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /home/cascading/cascading.compatibility/biginsights-4.0.x/build/test/output//hadoop2-mr1/hadoopmr1tapplatform/testCombinedPartitionTap/combinedpartition/partitioned
2015-08-12 19:32:36,114 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /home/cascading/cascading.compatibility/biginsights-4.0.x/build/test/output//hadoop2-mr1/hadoopmr1tapplatform/testCombinedPartitionTap/combinedpartition/final

Aug 12, 2015 7:31:35 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class
Aug 12, 2015 7:31:35 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class
Aug 12, 2015 7:31:35 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Aug 12, 2015 7:31:35 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Aug 12, 2015 7:31:35 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Aug 12, 2015 7:31:36 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Aug 12, 2015 7:31:37 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest"
Aug 12, 2015 7:31:37 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Aug 12, 2015 7:31:37 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Aug 12, 2015 7:31:37 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class
Aug 12, 2015 7:31:37 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class
Aug 12, 2015 7:31:37 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Aug 12, 2015 7:31:37 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Aug 12, 2015 7:31:37 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Aug 12, 2015 7:31:37 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Aug 12, 2015 7:31:38 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Aug 12, 2015 7:31:38 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Aug 12, 2015 7:31:38 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
Aug 12, 2015 7:31:38 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Aug 12, 2015 7:31:38 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
Aug 12, 2015 7:31:38 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Aug 12, 2015 7:31:38 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Aug 12, 2015 7:31:38 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Aug 12, 2015 7:31:38 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Aug 12, 2015 7:31:38 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Aug 12, 2015 7:31:39 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
Aug 12, 2015 7:31:39 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Aug 12, 2015 7:31:39 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
Aug 12, 2015 7:31:39 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Aug 12, 2015 7:31:39 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Aug 12, 2015 7:31:39 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Aug 12, 2015 7:31:39 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Aug 12, 2015 7:31:39 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.