Class cascading.tap.hadoop.DistCacheTapPlatformTest

5

tests

0

failures

0

ignored

2m29.63s

duration

100%

successful

Tests

Test Duration Result
testDirectory 21.133s passed
testGlobSupport 46.043s passed
testHashJoinCheckpointWithDistCacheDecorator 41.397s passed
testHashJoinDistCacheTapLHS 20.319s passed
testHashJoinDistCacheTapRHS 20.739s passed

Standard output

2016-05-18 05:56:50,504 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(197)) - found 1 test platforms from classpath
2016-05-18 05:56:50,528 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(246)) - adding test: cascading.tap.hadoop.DistCacheTapPlatformTest, with platform: hadoop2-mr1
2016-05-18 05:56:50,561 INFO  hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(136)) - using cluster
2016-05-18 05:56:51,425 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
2016-05-18 05:56:52,086 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2016-05-18 05:56:52,600 WARN  server.AuthenticationFilter (AuthenticationFilter.java:init(166)) - 'signature.secret' configuration not set, using a random value as secret
2016-05-18 05:56:55,703 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-05-18 05:56:55,855 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-05-18 05:56:55,967 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-05-18 05:56:56,079 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-05-18 05:57:07,903 WARN  server.AuthenticationFilter (AuthenticationFilter.java:init(166)) - 'signature.secret' configuration not set, using a random value as secret
2016-05-18 05:57:08,878 WARN  server.AuthenticationFilter (AuthenticationFilter.java:init(166)) - 'signature.secret' configuration not set, using a random value as secret
2016-05-18 05:57:08,879 WARN  server.AuthenticationFilter (AuthenticationFilter.java:init(166)) - 'signature.secret' configuration not set, using a random value as secret
2016-05-18 05:57:13,159 INFO  platform.TestPlatform (TestPlatform.java:getGlobalProperties(75)) - platform property overrides: 
2016-05-18 05:57:13,375 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 05:57:13,377 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(176)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.1.0/fdadb6ac788ea19f3412b9569a43a7635318b0c5/cascading-hadoop2-mr1-3.1.0.jar
2016-05-18 05:57:13,446 INFO  property.AppProps (AppProps.java:getAppID(177)) - using app.id: AD8A86EB1C2A40A2A4679DA955B76BCD
2016-05-18 05:57:13,581 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.097
2016-05-18 05:57:13,584 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-18 05:57:13,584 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 05:57:13,621 INFO  hadoop.BaseDistCacheTap (BaseDistCacheTap.java:registerURI(155)) - adding hdfs://localhost:58939/tmp/distcachetap389887178370208842534398531969039/upper_0.txt to local resource configuration 
2016-05-18 05:57:13,622 INFO  hadoop.BaseDistCacheTap (BaseDistCacheTap.java:registerURI(155)) - adding hdfs://localhost:58939/tmp/distcachetap389887178370208842534398531969039/upper_1.txt to local resource configuration 
2016-05-18 05:57:13,622 INFO  hadoop.BaseDistCacheTap (BaseDistCacheTap.java:registerURI(155)) - adding hdfs://localhost:58939/tmp/distcachetap389887178370208842534398531969039/upper_2.txt to local resource configuration 
2016-05-18 05:57:13,622 INFO  hadoop.BaseDistCacheTap (BaseDistCacheTap.java:registerURI(155)) - adding hdfs://localhost:58939/tmp/distcachetap389887178370208842534398531969039/upper_3.txt to local resource configuration 
2016-05-18 05:57:13,623 INFO  hadoop.BaseDistCacheTap (BaseDistCacheTap.java:registerURI(155)) - adding hdfs://localhost:58939/tmp/distcachetap389887178370208842534398531969039/upper_4.txt to local resource configuration 
2016-05-18 05:57:13,719 INFO  util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.1.0
2016-05-18 05:57:13,721 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] starting
2016-05-18 05:57:13,722 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/tmp/distcachetap389887178370208842534398531969039/*"]
2016-05-18 05:57:13,722 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/classes/test/data/lower.txt"]
2016-05-18 05:57:13,722 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/test/output/hadoop2-mr1/distcachetapplatform/testGlobSupport/testGlobSupportjoin"]
2016-05-18 05:57:13,724 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  parallel execution of steps is enabled: true
2016-05-18 05:57:13,725 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  executing total steps: 1
2016-05-18 05:57:13,725 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  allocating management threads: 1
2016-05-18 05:57:13,726 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] starting step: (1/1) ...pport/testGlobSupportjoin
2016-05-18 05:57:14,721 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] submitted hadoop job: job_1463551027658_0001
2016-05-18 05:57:14,721 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] tracking url: http://ip-10-158-37-203:45331/proxy/application_1463551027658_0001/
2016-05-18 05:57:34,690 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463551027658_0001_01_000003 is : 143
2016-05-18 05:57:34,866 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463551027658_0001_01_000002 is : 143
2016-05-18 05:57:35,102 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463551027658_0001_01_000005 is : 143
2016-05-18 05:57:36,462 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/test/output/hadoop2-mr1/distcachetapplatform/testGlobSupport/testGlobSupportjoin/_temporary
2016-05-18 05:57:36,464 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  completed in: 00:22.738, using cpu time: 00:07.600
2016-05-18 05:57:36,586 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/test/output//hadoop2-mr1/distcachetapplatform/testGlobSupport/testGlobSupportjoin
2016-05-18 05:57:36,644 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 05:57:36,645 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(176)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.1.0/fdadb6ac788ea19f3412b9569a43a7635318b0c5/cascading-hadoop2-mr1-3.1.0.jar
2016-05-18 05:57:36,710 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.057
2016-05-18 05:57:36,713 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-18 05:57:36,713 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 05:57:36,718 INFO  hadoop.BaseDistCacheTap (BaseDistCacheTap.java:registerURI(155)) - adding /tmp/distcachetap65855670221859596134421925444286 to local resource configuration 
2016-05-18 05:57:36,738 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] starting
2016-05-18 05:57:36,739 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/tmp/distcachetap65855670221859596134421925444286"]
2016-05-18 05:57:36,739 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/classes/test/data/lower.txt"]
2016-05-18 05:57:36,739 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/test/output/hadoop2-mr1/distcachetapplatform/testDirectory/testDirectoryjoin"]
2016-05-18 05:57:36,740 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  parallel execution of steps is enabled: true
2016-05-18 05:57:36,740 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  executing total steps: 1
2016-05-18 05:57:36,740 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  allocating management threads: 1
2016-05-18 05:57:36,741 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] starting step: (1/1) ...rectory/testDirectoryjoin
2016-05-18 05:57:36,922 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] submitted hadoop job: job_1463551027658_0002
2016-05-18 05:57:36,922 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] tracking url: http://ip-10-158-37-203:45331/proxy/application_1463551027658_0002/
2016-05-18 05:57:56,178 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463551027658_0002_01_000006 is : 143
2016-05-18 05:57:56,220 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463551027658_0002_01_000002 is : 143
2016-05-18 05:57:56,258 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463551027658_0002_01_000003 is : 143
2016-05-18 05:57:56,296 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463551027658_0002_01_000004 is : 143
2016-05-18 05:57:56,395 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463551027658_0002_01_000005 is : 143
2016-05-18 05:57:57,658 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/test/output/hadoop2-mr1/distcachetapplatform/testDirectory/testDirectoryjoin/_temporary
2016-05-18 05:57:57,660 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  completed in: 00:20.918, using cpu time: 00:06.310
2016-05-18 05:57:57,721 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/test/output//hadoop2-mr1/distcachetapplatform/testDirectory/testDirectoryjoin
2016-05-18 05:57:57,774 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 05:57:57,774 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(176)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.1.0/fdadb6ac788ea19f3412b9569a43a7635318b0c5/cascading-hadoop2-mr1-3.1.0.jar
2016-05-18 05:57:57,793 INFO  planner.FlowPlanner (FlowPlanner.java:decorateTap(798)) - found decorator: cascading.flowconnector.checkpoint_tap.decorator.classname, wrapping tap: TempHfs["null"][9567988943/upper/]
2016-05-18 05:57:57,853 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.072
2016-05-18 05:57:57,856 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 2, nodes: 2
2016-05-18 05:57:57,856 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 05:57:57,881 INFO  hadoop.BaseDistCacheTap (BaseDistCacheTap.java:registerURI(155)) - adding /tmp/hadoop-teamcity/9567988943_upper_AFCE8D03B23143969B38B3BF7E39E256 to local resource configuration 
2016-05-18 05:57:57,894 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper] starting
2016-05-18 05:57:57,895 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/classes/test/data/upper.txt"]
2016-05-18 05:57:57,895 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/classes/test/data/lower.txt"]
2016-05-18 05:57:57,895 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper]  sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/test/output/hadoop2-mr1/distcachetapplatform/testHashJoinCheckpointWithDistCacheDecorator/join"]
2016-05-18 05:57:57,895 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper]  parallel execution of steps is enabled: true
2016-05-18 05:57:57,895 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper]  executing total steps: 2
2016-05-18 05:57:57,895 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper]  allocating management threads: 2
2016-05-18 05:57:57,897 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper] starting step: (1/2)
2016-05-18 05:57:58,047 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper] submitted hadoop job: job_1463551027658_0003
2016-05-18 05:57:58,047 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper] tracking url: http://ip-10-158-37-203:45331/proxy/application_1463551027658_0003/
2016-05-18 05:58:16,102 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463551027658_0003_01_000002 is : 143
2016-05-18 05:58:16,338 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463551027658_0003_01_000003 is : 143
2016-05-18 05:58:16,691 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463551027658_0003_01_000006 is : 143
2016-05-18 05:58:16,846 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463551027658_0003_01_000005 is : 143
2016-05-18 05:58:17,095 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463551027658_0003_01_000004 is : 143
2016-05-18 05:58:18,297 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper] starting step: (2/2) ...thDistCacheDecorator/join
2016-05-18 05:58:18,485 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper] submitted hadoop job: job_1463551027658_0004
2016-05-18 05:58:18,485 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper] tracking url: http://ip-10-158-37-203:45331/proxy/application_1463551027658_0004/
2016-05-18 05:58:37,394 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463551027658_0004_01_000003 is : 143
2016-05-18 05:58:37,492 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463551027658_0004_01_000002 is : 143
2016-05-18 05:58:37,588 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463551027658_0004_01_000006 is : 143
2016-05-18 05:58:37,659 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463551027658_0004_01_000004 is : 143
2016-05-18 05:58:37,812 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463551027658_0004_01_000005 is : 143
2016-05-18 05:58:39,066 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/test/output/hadoop2-mr1/distcachetapplatform/testHashJoinCheckpointWithDistCacheDecorator/join/_temporary
2016-05-18 05:58:39,068 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper]  completed in: 00:41.166, using cpu time: 00:12.200
2016-05-18 05:58:39,121 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/test/output//hadoop2-mr1/distcachetapplatform/testHashJoinCheckpointWithDistCacheDecorator/join
2016-05-18 05:58:39,153 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 05:58:39,154 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(176)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.1.0/fdadb6ac788ea19f3412b9569a43a7635318b0c5/cascading-hadoop2-mr1-3.1.0.jar
2016-05-18 05:58:39,202 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.043
2016-05-18 05:58:39,207 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-18 05:58:39,208 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 05:58:39,210 INFO  hadoop.BaseDistCacheTap (BaseDistCacheTap.java:sourceConfInit(65)) - can't use distributed cache. reading '/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/classes/test/data/lower.txt' from hdfs
2016-05-18 05:58:39,226 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] starting
2016-05-18 05:58:39,227 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/classes/test/data/upper.txt"]
2016-05-18 05:58:39,227 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/classes/test/data/lower.txt"]
2016-05-18 05:58:39,228 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/test/output/hadoop2-mr1/distcachetapplatform/testHashJoinDistCacheTapLHS/testHashJoinDistCacheTapLHSjoin"]
2016-05-18 05:58:39,228 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  parallel execution of steps is enabled: true
2016-05-18 05:58:39,229 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  executing total steps: 1
2016-05-18 05:58:39,229 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  allocating management threads: 1
2016-05-18 05:58:39,229 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] starting step: (1/1) ...shJoinDistCacheTapLHSjoin
2016-05-18 05:58:39,433 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] submitted hadoop job: job_1463551027658_0005
2016-05-18 05:58:39,433 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] tracking url: http://ip-10-158-37-203:45331/proxy/application_1463551027658_0005/
2016-05-18 05:58:57,021 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463551027658_0005_01_000006 is : 143
2016-05-18 05:58:57,726 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463551027658_0005_01_000002 is : 143
2016-05-18 05:58:57,793 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463551027658_0005_01_000005 is : 143
2016-05-18 05:58:57,888 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463551027658_0005_01_000004 is : 143
2016-05-18 05:58:58,131 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463551027658_0005_01_000003 is : 143
2016-05-18 05:58:59,363 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/test/output/hadoop2-mr1/distcachetapplatform/testHashJoinDistCacheTapLHS/testHashJoinDistCacheTapLHSjoin/_temporary
2016-05-18 05:58:59,365 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  completed in: 00:20.134, using cpu time: 00:05.730
2016-05-18 05:58:59,439 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/test/output//hadoop2-mr1/distcachetapplatform/testHashJoinDistCacheTapLHS/testHashJoinDistCacheTapLHSjoin
2016-05-18 05:58:59,471 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 05:58:59,471 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(176)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.1.0/fdadb6ac788ea19f3412b9569a43a7635318b0c5/cascading-hadoop2-mr1-3.1.0.jar
2016-05-18 05:58:59,523 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.046
2016-05-18 05:58:59,524 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-18 05:58:59,524 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 05:58:59,528 INFO  hadoop.BaseDistCacheTap (BaseDistCacheTap.java:registerURI(155)) - adding /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/classes/test/data/upper.txt to local resource configuration 
2016-05-18 05:58:59,542 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] starting
2016-05-18 05:58:59,542 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/classes/test/data/upper.txt"]
2016-05-18 05:58:59,543 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/classes/test/data/lower.txt"]
2016-05-18 05:58:59,543 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/test/output/hadoop2-mr1/distcachetapplatform/testHashJoinDistCacheTapRHS/testHashJoinDistCacheTapRHSjoin"]
2016-05-18 05:58:59,544 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  parallel execution of steps is enabled: true
2016-05-18 05:58:59,544 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  executing total steps: 1
2016-05-18 05:58:59,544 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  allocating management threads: 1
2016-05-18 05:58:59,545 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] starting step: (1/1) ...shJoinDistCacheTapRHSjoin
2016-05-18 05:58:59,728 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] submitted hadoop job: job_1463551027658_0006
2016-05-18 05:58:59,728 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] tracking url: http://ip-10-158-37-203:45331/proxy/application_1463551027658_0006/
2016-05-18 05:59:18,406 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463551027658_0006_01_000006 is : 143
2016-05-18 05:59:18,738 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463551027658_0006_01_000002 is : 143
2016-05-18 05:59:18,840 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463551027658_0006_01_000004 is : 143
2016-05-18 05:59:18,878 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463551027658_0006_01_000003 is : 143
2016-05-18 05:59:20,126 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/test/output/hadoop2-mr1/distcachetapplatform/testHashJoinDistCacheTapRHS/testHashJoinDistCacheTapRHSjoin/_temporary
2016-05-18 05:59:20,128 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  completed in: 00:20.582, using cpu time: 00:06.190
2016-05-18 05:59:20,180 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.5.x/build/test/output//hadoop2-mr1/distcachetapplatform/testHashJoinDistCacheTapRHS/testHashJoinDistCacheTapRHSjoin

Standard error

May 18, 2016 5:57:08 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class
May 18, 2016 5:57:08 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class
May 18, 2016 5:57:08 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 18, 2016 5:57:08 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 18, 2016 5:57:08 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 5:57:08 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 5:57:08 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest"
May 18, 2016 5:57:08 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 18, 2016 5:57:09 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class
May 18, 2016 5:57:09 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class
May 18, 2016 5:57:09 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 18, 2016 5:57:09 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 18, 2016 5:57:09 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 5:57:09 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 5:57:09 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 5:57:09 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 18, 2016 5:57:10 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
May 18, 2016 5:57:10 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 18, 2016 5:57:10 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
May 18, 2016 5:57:10 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 18, 2016 5:57:10 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 5:57:10 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 5:57:10 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 5:57:10 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 18, 2016 5:57:11 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
May 18, 2016 5:57:11 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 18, 2016 5:57:11 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
May 18, 2016 5:57:11 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 18, 2016 5:57:11 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 5:57:11 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 5:57:11 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 5:57:11 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 18, 2016 5:57:12 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
May 18, 2016 5:57:12 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 18, 2016 5:57:12 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
May 18, 2016 5:57:12 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 18, 2016 5:57:12 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 5:57:12 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 5:57:12 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 5:57:12 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.