Class cascading.tap.hadoop.DistCacheTapPlatformTest

5

tests

0

failures

0

ignored

2m25.40s

duration

100%

successful

Tests

Test Duration Result
testDirectory 20.959s passed
testGlobSupport 45.055s passed
testHashJoinCheckpointWithDistCacheDecorator 39.861s passed
testHashJoinDistCacheTapLHS 19.715s passed
testHashJoinDistCacheTapRHS 19.811s passed

Standard output

2016-05-18 01:03:42,819 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(197)) - found 1 test platforms from classpath
2016-05-18 01:03:42,848 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(246)) - adding test: cascading.tap.hadoop.DistCacheTapPlatformTest, with platform: hadoop2-mr1
2016-05-18 01:03:42,879 INFO  hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(136)) - using cluster
2016-05-18 01:03:43,674 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
2016-05-18 01:03:44,228 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2016-05-18 01:03:44,726 WARN  server.AuthenticationFilter (AuthenticationFilter.java:init(158)) - 'signature.secret' configuration not set, using a random value as secret
2016-05-18 01:03:47,565 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-05-18 01:03:47,705 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-05-18 01:03:47,819 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-05-18 01:03:47,929 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-05-18 01:04:05,000 INFO  platform.TestPlatform (TestPlatform.java:getGlobalProperties(75)) - platform property overrides: 
2016-05-18 01:04:05,220 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 01:04:05,221 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(176)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.1.0/fdadb6ac788ea19f3412b9569a43a7635318b0c5/cascading-hadoop2-mr1-3.1.0.jar
2016-05-18 01:04:05,286 INFO  property.AppProps (AppProps.java:getAppID(177)) - using app.id: 272D15F26790461A9004E16104977A8D
2016-05-18 01:04:05,421 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.098
2016-05-18 01:04:05,424 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-18 01:04:05,426 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 01:04:05,462 INFO  hadoop.BaseDistCacheTap (BaseDistCacheTap.java:registerURI(155)) - adding hdfs://localhost:60604/tmp/distcachetap739378919321399906416810369769782/upper_0.txt to local resource configuration 
2016-05-18 01:04:05,463 INFO  hadoop.BaseDistCacheTap (BaseDistCacheTap.java:registerURI(155)) - adding hdfs://localhost:60604/tmp/distcachetap739378919321399906416810369769782/upper_1.txt to local resource configuration 
2016-05-18 01:04:05,463 INFO  hadoop.BaseDistCacheTap (BaseDistCacheTap.java:registerURI(155)) - adding hdfs://localhost:60604/tmp/distcachetap739378919321399906416810369769782/upper_2.txt to local resource configuration 
2016-05-18 01:04:05,463 INFO  hadoop.BaseDistCacheTap (BaseDistCacheTap.java:registerURI(155)) - adding hdfs://localhost:60604/tmp/distcachetap739378919321399906416810369769782/upper_3.txt to local resource configuration 
2016-05-18 01:04:05,464 INFO  hadoop.BaseDistCacheTap (BaseDistCacheTap.java:registerURI(155)) - adding hdfs://localhost:60604/tmp/distcachetap739378919321399906416810369769782/upper_4.txt to local resource configuration 
2016-05-18 01:04:05,561 INFO  util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.1.0
2016-05-18 01:04:05,562 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] starting
2016-05-18 01:04:05,563 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/tmp/distcachetap739378919321399906416810369769782/*"]
2016-05-18 01:04:05,563 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.3.x/build/classes/test/data/lower.txt"]
2016-05-18 01:04:05,564 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.3.x/build/test/output/hadoop2-mr1/distcachetapplatform/testGlobSupport/testGlobSupportjoin"]
2016-05-18 01:04:05,565 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  parallel execution of steps is enabled: true
2016-05-18 01:04:05,565 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  executing total steps: 1
2016-05-18 01:04:05,565 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  allocating management threads: 1
2016-05-18 01:04:05,567 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] starting step: (1/1) ...pport/testGlobSupportjoin
2016-05-18 01:04:06,415 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] submitted hadoop job: job_1463533439497_0001
2016-05-18 01:04:06,415 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] tracking url: http://ip-10-158-37-203.ec2.internal:51887/proxy/application_1463533439497_0001/
2016-05-18 01:04:25,027 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463533439497_0001_01_000006 is : 143
2016-05-18 01:04:25,430 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463533439497_0001_01_000003 is : 143
2016-05-18 01:04:25,716 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463533439497_0001_01_000005 is : 143
2016-05-18 01:04:25,806 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463533439497_0001_01_000002 is : 143
2016-05-18 01:04:26,501 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463533439497_0001_01_000004 is : 143
2016-05-18 01:04:27,823 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.3.x/build/test/output/hadoop2-mr1/distcachetapplatform/testGlobSupport/testGlobSupportjoin/_temporary
2016-05-18 01:04:27,827 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  completed in: 00:22.257, using cpu time: 00:07.310
2016-05-18 01:04:27,915 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.3.x/build/test/output//hadoop2-mr1/distcachetapplatform/testGlobSupport/testGlobSupportjoin
2016-05-18 01:04:27,972 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 01:04:27,973 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(176)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.1.0/fdadb6ac788ea19f3412b9569a43a7635318b0c5/cascading-hadoop2-mr1-3.1.0.jar
2016-05-18 01:04:28,042 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.063
2016-05-18 01:04:28,044 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-18 01:04:28,044 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 01:04:28,047 INFO  hadoop.BaseDistCacheTap (BaseDistCacheTap.java:registerURI(155)) - adding /tmp/distcachetap361224491576406430016833255380427 to local resource configuration 
2016-05-18 01:04:28,063 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] starting
2016-05-18 01:04:28,063 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/tmp/distcachetap361224491576406430016833255380427"]
2016-05-18 01:04:28,064 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.3.x/build/classes/test/data/lower.txt"]
2016-05-18 01:04:28,064 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.3.x/build/test/output/hadoop2-mr1/distcachetapplatform/testDirectory/testDirectoryjoin"]
2016-05-18 01:04:28,065 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  parallel execution of steps is enabled: true
2016-05-18 01:04:28,066 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  executing total steps: 1
2016-05-18 01:04:28,066 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  allocating management threads: 1
2016-05-18 01:04:28,067 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] starting step: (1/1) ...rectory/testDirectoryjoin
2016-05-18 01:04:28,278 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] submitted hadoop job: job_1463533439497_0002
2016-05-18 01:04:28,278 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] tracking url: http://ip-10-158-37-203.ec2.internal:51887/proxy/application_1463533439497_0002/
2016-05-18 01:04:45,899 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463533439497_0002_01_000002 is : 143
2016-05-18 01:04:46,225 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463533439497_0002_01_000003 is : 143
2016-05-18 01:04:46,519 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463533439497_0002_01_000006 is : 143
2016-05-18 01:04:46,548 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463533439497_0002_01_000004 is : 143
2016-05-18 01:04:47,570 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463533439497_0002_01_000005 is : 143
2016-05-18 01:04:48,820 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.3.x/build/test/output/hadoop2-mr1/distcachetapplatform/testDirectory/testDirectoryjoin/_temporary
2016-05-18 01:04:48,822 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  completed in: 00:20.755, using cpu time: 00:06.020
2016-05-18 01:04:48,877 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.3.x/build/test/output//hadoop2-mr1/distcachetapplatform/testDirectory/testDirectoryjoin
2016-05-18 01:04:48,931 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 01:04:48,931 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(176)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.1.0/fdadb6ac788ea19f3412b9569a43a7635318b0c5/cascading-hadoop2-mr1-3.1.0.jar
2016-05-18 01:04:48,953 INFO  planner.FlowPlanner (FlowPlanner.java:decorateTap(798)) - found decorator: cascading.flowconnector.checkpoint_tap.decorator.classname, wrapping tap: TempHfs["null"][3489003595/upper/]
2016-05-18 01:04:49,010 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.068
2016-05-18 01:04:49,012 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 2, nodes: 2
2016-05-18 01:04:49,012 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 01:04:49,029 INFO  hadoop.BaseDistCacheTap (BaseDistCacheTap.java:registerURI(155)) - adding /tmp/hadoop-teamcity/3489003595_upper_4F3473B60705486F91EE47F53C054D71 to local resource configuration 
2016-05-18 01:04:49,042 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper] starting
2016-05-18 01:04:49,042 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.3.x/build/classes/test/data/upper.txt"]
2016-05-18 01:04:49,042 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.3.x/build/classes/test/data/lower.txt"]
2016-05-18 01:04:49,043 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper]  sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.3.x/build/test/output/hadoop2-mr1/distcachetapplatform/testHashJoinCheckpointWithDistCacheDecorator/join"]
2016-05-18 01:04:49,043 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper]  parallel execution of steps is enabled: true
2016-05-18 01:04:49,043 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper]  executing total steps: 2
2016-05-18 01:04:49,044 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper]  allocating management threads: 2
2016-05-18 01:04:49,045 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper] starting step: (1/2)
2016-05-18 01:04:49,197 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper] submitted hadoop job: job_1463533439497_0003
2016-05-18 01:04:49,197 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper] tracking url: http://ip-10-158-37-203.ec2.internal:51887/proxy/application_1463533439497_0003/
2016-05-18 01:05:07,341 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463533439497_0003_01_000005 is : 143
2016-05-18 01:05:07,406 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463533439497_0003_01_000002 is : 143
2016-05-18 01:05:07,561 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463533439497_0003_01_000004 is : 143
2016-05-18 01:05:07,598 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463533439497_0003_01_000003 is : 143
2016-05-18 01:05:08,804 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper] starting step: (2/2) ...thDistCacheDecorator/join
2016-05-18 01:05:08,960 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper] submitted hadoop job: job_1463533439497_0004
2016-05-18 01:05:08,960 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper] tracking url: http://ip-10-158-37-203.ec2.internal:51887/proxy/application_1463533439497_0004/
2016-05-18 01:05:26,855 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463533439497_0004_01_000002 is : 143
2016-05-18 01:05:27,131 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463533439497_0004_01_000005 is : 143
2016-05-18 01:05:27,411 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463533439497_0004_01_000004 is : 143
2016-05-18 01:05:27,435 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463533439497_0004_01_000006 is : 143
2016-05-18 01:05:28,689 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.3.x/build/test/output/hadoop2-mr1/distcachetapplatform/testHashJoinCheckpointWithDistCacheDecorator/join/_temporary
2016-05-18 01:05:28,690 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper]  completed in: 00:39.637, using cpu time: 00:12.110
2016-05-18 01:05:28,741 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.3.x/build/test/output//hadoop2-mr1/distcachetapplatform/testHashJoinCheckpointWithDistCacheDecorator/join
2016-05-18 01:05:28,771 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 01:05:28,772 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(176)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.1.0/fdadb6ac788ea19f3412b9569a43a7635318b0c5/cascading-hadoop2-mr1-3.1.0.jar
2016-05-18 01:05:28,818 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.041
2016-05-18 01:05:28,820 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-18 01:05:28,820 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 01:05:28,823 INFO  hadoop.BaseDistCacheTap (BaseDistCacheTap.java:sourceConfInit(65)) - can't use distributed cache. reading '/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.3.x/build/classes/test/data/lower.txt' from hdfs
2016-05-18 01:05:28,836 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] starting
2016-05-18 01:05:28,837 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.3.x/build/classes/test/data/upper.txt"]
2016-05-18 01:05:28,837 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.3.x/build/classes/test/data/lower.txt"]
2016-05-18 01:05:28,837 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.3.x/build/test/output/hadoop2-mr1/distcachetapplatform/testHashJoinDistCacheTapLHS/testHashJoinDistCacheTapLHSjoin"]
2016-05-18 01:05:28,838 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  parallel execution of steps is enabled: true
2016-05-18 01:05:28,839 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  executing total steps: 1
2016-05-18 01:05:28,839 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  allocating management threads: 1
2016-05-18 01:05:28,840 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] starting step: (1/1) ...shJoinDistCacheTapLHSjoin
2016-05-18 01:05:28,999 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] submitted hadoop job: job_1463533439497_0005
2016-05-18 01:05:28,999 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] tracking url: http://ip-10-158-37-203.ec2.internal:51887/proxy/application_1463533439497_0005/
2016-05-18 01:05:46,474 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463533439497_0005_01_000004 is : 143
2016-05-18 01:05:46,672 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463533439497_0005_01_000002 is : 143
2016-05-18 01:05:46,735 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463533439497_0005_01_000003 is : 143
2016-05-18 01:05:47,126 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463533439497_0005_01_000005 is : 143
2016-05-18 01:05:47,165 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463533439497_0005_01_000006 is : 143
2016-05-18 01:05:48,407 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.3.x/build/test/output/hadoop2-mr1/distcachetapplatform/testHashJoinDistCacheTapLHS/testHashJoinDistCacheTapLHSjoin/_temporary
2016-05-18 01:05:48,408 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  completed in: 00:19.566, using cpu time: 00:05.560
2016-05-18 01:05:48,456 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.3.x/build/test/output//hadoop2-mr1/distcachetapplatform/testHashJoinDistCacheTapLHS/testHashJoinDistCacheTapLHSjoin
2016-05-18 01:05:48,485 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 01:05:48,485 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(176)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.1.0/fdadb6ac788ea19f3412b9569a43a7635318b0c5/cascading-hadoop2-mr1-3.1.0.jar
2016-05-18 01:05:48,534 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.045
2016-05-18 01:05:48,535 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-18 01:05:48,535 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 01:05:48,538 INFO  hadoop.BaseDistCacheTap (BaseDistCacheTap.java:registerURI(155)) - adding /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.3.x/build/classes/test/data/upper.txt to local resource configuration 
2016-05-18 01:05:48,550 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] starting
2016-05-18 01:05:48,550 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.3.x/build/classes/test/data/upper.txt"]
2016-05-18 01:05:48,550 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.3.x/build/classes/test/data/lower.txt"]
2016-05-18 01:05:48,551 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.3.x/build/test/output/hadoop2-mr1/distcachetapplatform/testHashJoinDistCacheTapRHS/testHashJoinDistCacheTapRHSjoin"]
2016-05-18 01:05:48,552 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  parallel execution of steps is enabled: true
2016-05-18 01:05:48,552 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  executing total steps: 1
2016-05-18 01:05:48,552 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  allocating management threads: 1
2016-05-18 01:05:48,553 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] starting step: (1/1) ...shJoinDistCacheTapRHSjoin
2016-05-18 01:05:48,709 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] submitted hadoop job: job_1463533439497_0006
2016-05-18 01:05:48,709 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] tracking url: http://ip-10-158-37-203.ec2.internal:51887/proxy/application_1463533439497_0006/
2016-05-18 01:06:05,990 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463533439497_0006_01_000006 is : 143
2016-05-18 01:06:06,676 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463533439497_0006_01_000005 is : 143
2016-05-18 01:06:06,813 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463533439497_0006_01_000004 is : 143
2016-05-18 01:06:06,848 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463533439497_0006_01_000002 is : 143
2016-05-18 01:06:06,974 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1463533439497_0006_01_000003 is : 143
2016-05-18 01:06:08,217 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.3.x/build/test/output/hadoop2-mr1/distcachetapplatform/testHashJoinDistCacheTapRHS/testHashJoinDistCacheTapRHSjoin/_temporary
2016-05-18 01:06:08,218 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  completed in: 00:19.665, using cpu time: 00:05.840
2016-05-18 01:06:08,269 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.3.x/build/test/output//hadoop2-mr1/distcachetapplatform/testHashJoinDistCacheTapRHS/testHashJoinDistCacheTapRHSjoin

Standard error

May 18, 2016 1:03:59 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class
May 18, 2016 1:03:59 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class
May 18, 2016 1:03:59 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 18, 2016 1:03:59 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 18, 2016 1:03:59 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 1:04:00 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 1:04:00 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest"
May 18, 2016 1:04:00 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 18, 2016 1:04:01 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class
May 18, 2016 1:04:01 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class
May 18, 2016 1:04:01 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 18, 2016 1:04:01 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 18, 2016 1:04:01 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 1:04:01 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 1:04:01 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 1:04:01 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 18, 2016 1:04:02 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
May 18, 2016 1:04:02 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 18, 2016 1:04:02 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
May 18, 2016 1:04:02 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 18, 2016 1:04:02 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 1:04:02 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 1:04:02 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 1:04:02 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 18, 2016 1:04:03 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
May 18, 2016 1:04:03 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 18, 2016 1:04:03 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
May 18, 2016 1:04:03 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 18, 2016 1:04:03 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 1:04:03 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 1:04:03 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 1:04:03 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 18, 2016 1:04:04 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
May 18, 2016 1:04:04 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 18, 2016 1:04:04 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
May 18, 2016 1:04:04 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 18, 2016 1:04:04 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 1:04:04 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 1:04:04 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 1:04:04 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.