Class cascading.tap.hadoop.DistCacheTapPlatformTest

5

tests

0

failures

0

ignored

2m3.33s

duration

100%

successful

Tests

Test Duration Result
testDirectory 17.074s passed
testGlobSupport 36.425s passed
testHashJoinCheckpointWithDistCacheDecorator 35.040s passed
testHashJoinDistCacheTapLHS 17.494s passed
testHashJoinDistCacheTapRHS 17.298s passed

Standard output

2015-11-23 16:54:34,334 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(195)) - found 1 test platforms from classpath
2015-11-23 16:54:34,350 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(244)) - adding test: cascading.tap.hadoop.DistCacheTapPlatformTest, with platform: hadoop2-mr1
2015-11-23 16:54:34,362 INFO  hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(136)) - using cluster
2015-11-23 16:54:34,953 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
2015-11-23 16:54:35,614 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(125)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2015-11-23 16:54:39,551 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-11-23 16:54:39,756 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-11-23 16:54:39,949 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-11-23 16:54:40,141 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-11-23 16:54:57,238 INFO  platform.TestPlatform (TestPlatform.java:getGlobalProperties(73)) - platform property overrides: 
2015-11-23 16:54:57,562 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:54:57,563 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:54:57,605 INFO  property.AppProps (AppProps.java:getAppID(177)) - using app.id: 4B699210EF9240F1BF6D5BD85EF119DF
2015-11-23 16:54:57,698 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.063
2015-11-23 16:54:57,700 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2015-11-23 16:54:57,701 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:54:57,734 INFO  hadoop.DistCacheTap (BaseDistCacheTap.java:registerURI(154)) - adding hdfs://localhost:37163/tmp/distcachetap6104752698890737803458127474810192/upper_0.txt to local resource configuration 
2015-11-23 16:54:57,735 INFO  hadoop.DistCacheTap (BaseDistCacheTap.java:registerURI(154)) - adding hdfs://localhost:37163/tmp/distcachetap6104752698890737803458127474810192/upper_1.txt to local resource configuration 
2015-11-23 16:54:57,735 INFO  hadoop.DistCacheTap (BaseDistCacheTap.java:registerURI(154)) - adding hdfs://localhost:37163/tmp/distcachetap6104752698890737803458127474810192/upper_2.txt to local resource configuration 
2015-11-23 16:54:57,735 INFO  hadoop.DistCacheTap (BaseDistCacheTap.java:registerURI(154)) - adding hdfs://localhost:37163/tmp/distcachetap6104752698890737803458127474810192/upper_3.txt to local resource configuration 
2015-11-23 16:54:57,735 INFO  hadoop.DistCacheTap (BaseDistCacheTap.java:registerURI(154)) - adding hdfs://localhost:37163/tmp/distcachetap6104752698890737803458127474810192/upper_4.txt to local resource configuration 
2015-11-23 16:54:57,975 INFO  util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.0.2
2015-11-23 16:54:57,977 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test] starting
2015-11-23 16:54:57,977 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lower.txt"]
2015-11-23 16:54:57,977 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/tmp/distcachetap6104752698890737803458127474810192/*"]
2015-11-23 16:54:57,977 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test]  sink: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/distcachetapplatform/testGlobSupport/testGlobSupportjoin"]
2015-11-23 16:54:57,979 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test]  parallel execution of steps is enabled: true
2015-11-23 16:54:57,979 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test]  executing total steps: 1
2015-11-23 16:54:57,979 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test]  allocating management threads: 1
2015-11-23 16:54:57,981 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test] starting step: (1/1) ...pport/testGlobSupportjoin
2015-11-23 16:54:58,843 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test] submitted hadoop job: job_1448268891736_0001
2015-11-23 16:54:58,844 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test] tracking url: http://shihc046-public.cn.ibm.com:53751/proxy/application_1448268891736_0001/
2015-11-23 16:55:08,283 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268891736_0001_01_000003 is : 143
2015-11-23 16:55:09,193 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268891736_0001_01_000006 is : 143
2015-11-23 16:55:09,377 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268891736_0001_01_000004 is : 143
2015-11-23 16:55:09,434 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268891736_0001_01_000005 is : 143
2015-11-23 16:55:10,681 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/distcachetapplatform/testGlobSupport/testGlobSupportjoin/_temporary
2015-11-23 16:55:10,687 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test]  completed in: 00:12.702, using cpu time: 00:06.310
2015-11-23 16:55:10,769 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/distcachetapplatform/testGlobSupport/testGlobSupportjoin
2015-11-23 16:55:10,829 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:55:10,829 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:55:10,862 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.028
2015-11-23 16:55:10,863 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2015-11-23 16:55:10,863 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:55:10,865 INFO  hadoop.DistCacheTap (BaseDistCacheTap.java:registerURI(154)) - adding /tmp/distcachetap84232431707286061573458140937071418 to local resource configuration 
2015-11-23 16:55:10,879 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test] starting
2015-11-23 16:55:10,879 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lower.txt"]
2015-11-23 16:55:10,879 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/tmp/distcachetap84232431707286061573458140937071418"]
2015-11-23 16:55:10,879 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test]  sink: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/distcachetapplatform/testDirectory/testDirectoryjoin"]
2015-11-23 16:55:10,880 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test]  parallel execution of steps is enabled: true
2015-11-23 16:55:10,881 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test]  executing total steps: 1
2015-11-23 16:55:10,881 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test]  allocating management threads: 1
2015-11-23 16:55:10,882 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test] starting step: (1/1) ...rectory/testDirectoryjoin
2015-11-23 16:55:11,028 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test] submitted hadoop job: job_1448268891736_0002
2015-11-23 16:55:11,028 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test] tracking url: http://shihc046-public.cn.ibm.com:53751/proxy/application_1448268891736_0002/
2015-11-23 16:55:25,805 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268891736_0002_01_000006 is : 143
2015-11-23 16:55:26,438 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268891736_0002_01_000003 is : 143
2015-11-23 16:55:26,457 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268891736_0002_01_000004 is : 143
2015-11-23 16:55:26,483 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268891736_0002_01_000002 is : 143
2015-11-23 16:55:26,573 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268891736_0002_01_000005 is : 143
2015-11-23 16:55:27,788 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/distcachetapplatform/testDirectory/testDirectoryjoin/_temporary
2015-11-23 16:55:27,793 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test]  completed in: 00:16.906, using cpu time: 00:04.600
2015-11-23 16:55:27,848 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/distcachetapplatform/testDirectory/testDirectoryjoin
2015-11-23 16:55:27,888 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:55:27,888 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:55:27,899 INFO  planner.FlowPlanner (FlowPlanner.java:decorateTap(797)) - found decorator: cascading.flowconnector.checkpoint_tap.decorator.classname, wrapping tap: TempHfs["null"][638019219/upper/]
2015-11-23 16:55:27,923 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.030
2015-11-23 16:55:27,923 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 2, nodes: 2
2015-11-23 16:55:27,924 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:55:27,936 INFO  hadoop.DistCacheTap (BaseDistCacheTap.java:registerURI(154)) - adding /tmp/hadoop-root/638019219_upper_477BEFD1159B41F19CB4A58193530128 to local resource configuration 
2015-11-23 16:55:27,947 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] starting
2015-11-23 16:55:27,947 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lower.txt"]
2015-11-23 16:55:27,947 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/upper.txt"]
2015-11-23 16:55:27,948 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper]  sink: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/distcachetapplatform/testHashJoinCheckpointWithDistCacheDecorator/join"]
2015-11-23 16:55:27,948 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper]  parallel execution of steps is enabled: true
2015-11-23 16:55:27,948 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper]  executing total steps: 2
2015-11-23 16:55:27,948 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper]  allocating management threads: 2
2015-11-23 16:55:27,950 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] starting step: (1/2)
2015-11-23 16:55:28,102 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] submitted hadoop job: job_1448268891736_0003
2015-11-23 16:55:28,102 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] tracking url: http://shihc046-public.cn.ibm.com:53751/proxy/application_1448268891736_0003/
2015-11-23 16:55:43,207 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268891736_0003_01_000006 is : 143
2015-11-23 16:55:43,258 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268891736_0003_01_000003 is : 143
2015-11-23 16:55:43,293 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268891736_0003_01_000004 is : 143
2015-11-23 16:55:44,254 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268891736_0003_01_000002 is : 143
2015-11-23 16:55:44,276 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268891736_0003_01_000005 is : 143
2015-11-23 16:55:45,426 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] starting step: (2/2) ...thDistCacheDecorator/join
2015-11-23 16:55:45,573 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] submitted hadoop job: job_1448268891736_0004
2015-11-23 16:55:45,573 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper] tracking url: http://shihc046-public.cn.ibm.com:53751/proxy/application_1448268891736_0004/
2015-11-23 16:56:00,583 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268891736_0004_01_000006 is : 143
2015-11-23 16:56:00,584 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268891736_0004_01_000004 is : 143
2015-11-23 16:56:00,608 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268891736_0004_01_000005 is : 143
2015-11-23 16:56:00,636 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268891736_0004_01_000003 is : 143
2015-11-23 16:56:01,646 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268891736_0004_01_000002 is : 143
2015-11-23 16:56:02,825 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/distcachetapplatform/testHashJoinCheckpointWithDistCacheDecorator/join/_temporary
2015-11-23 16:56:02,831 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [lower*upper]  completed in: 00:34.874, using cpu time: 00:09.670
2015-11-23 16:56:02,890 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/distcachetapplatform/testHashJoinCheckpointWithDistCacheDecorator/join
2015-11-23 16:56:02,920 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:56:02,921 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:56:02,945 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.020
2015-11-23 16:56:02,945 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2015-11-23 16:56:02,946 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:56:02,947 INFO  hadoop.DistCacheTap (BaseDistCacheTap.java:sourceConfInit(64)) - can't use distributed cache. reading '/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lower.txt' from hdfs
2015-11-23 16:56:02,961 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test] starting
2015-11-23 16:56:02,962 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lower.txt"]
2015-11-23 16:56:02,962 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/upper.txt"]
2015-11-23 16:56:02,962 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test]  sink: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/distcachetapplatform/testHashJoinDistCacheTapLHS/testHashJoinDistCacheTapLHSjoin"]
2015-11-23 16:56:02,962 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test]  parallel execution of steps is enabled: true
2015-11-23 16:56:02,962 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test]  executing total steps: 1
2015-11-23 16:56:02,962 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test]  allocating management threads: 1
2015-11-23 16:56:02,964 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test] starting step: (1/1) ...shJoinDistCacheTapLHSjoin
2015-11-23 16:56:03,309 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test] submitted hadoop job: job_1448268891736_0005
2015-11-23 16:56:03,309 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test] tracking url: http://shihc046-public.cn.ibm.com:53751/proxy/application_1448268891736_0005/
2015-11-23 16:56:17,904 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268891736_0005_01_000006 is : 143
2015-11-23 16:56:17,996 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268891736_0005_01_000004 is : 143
2015-11-23 16:56:18,040 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268891736_0005_01_000003 is : 143
2015-11-23 16:56:18,058 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268891736_0005_01_000005 is : 143
2015-11-23 16:56:19,108 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268891736_0005_01_000002 is : 143
2015-11-23 16:56:20,321 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/distcachetapplatform/testHashJoinDistCacheTapLHS/testHashJoinDistCacheTapLHSjoin/_temporary
2015-11-23 16:56:20,326 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test]  completed in: 00:17.356, using cpu time: 00:04.330
2015-11-23 16:56:20,384 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/distcachetapplatform/testHashJoinDistCacheTapLHS/testHashJoinDistCacheTapLHSjoin
2015-11-23 16:56:20,412 INFO  util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:56:20,412 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:56:20,434 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.018
2015-11-23 16:56:20,434 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2015-11-23 16:56:20,435 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:56:20,438 INFO  hadoop.DistCacheTap (BaseDistCacheTap.java:registerURI(154)) - adding /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/upper.txt to local resource configuration 
2015-11-23 16:56:20,452 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test] starting
2015-11-23 16:56:20,452 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lower.txt"]
2015-11-23 16:56:20,453 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/upper.txt"]
2015-11-23 16:56:20,453 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test]  sink: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/distcachetapplatform/testHashJoinDistCacheTapRHS/testHashJoinDistCacheTapRHSjoin"]
2015-11-23 16:56:20,453 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test]  parallel execution of steps is enabled: true
2015-11-23 16:56:20,453 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test]  executing total steps: 1
2015-11-23 16:56:20,453 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test]  allocating management threads: 1
2015-11-23 16:56:20,455 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test] starting step: (1/1) ...shJoinDistCacheTapRHSjoin
2015-11-23 16:56:20,585 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test] submitted hadoop job: job_1448268891736_0006
2015-11-23 16:56:20,585 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test] tracking url: http://shihc046-public.cn.ibm.com:53751/proxy/application_1448268891736_0006/
2015-11-23 16:56:35,390 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268891736_0006_01_000002 is : 143
2015-11-23 16:56:35,415 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268891736_0006_01_000005 is : 143
2015-11-23 16:56:35,434 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268891736_0006_01_000003 is : 143
2015-11-23 16:56:35,455 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268891736_0006_01_000004 is : 143
2015-11-23 16:56:36,446 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268891736_0006_01_000006 is : 143
2015-11-23 16:56:37,624 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/distcachetapplatform/testHashJoinDistCacheTapRHS/testHashJoinDistCacheTapRHSjoin/_temporary
2015-11-23 16:56:37,628 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [distcache test]  completed in: 00:17.171, using cpu time: 00:04.600
2015-11-23 16:56:37,682 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/distcachetapplatform/testHashJoinDistCacheTapRHS/testHashJoinDistCacheTapRHSjoin

Standard error

Nov 23, 2015 4:54:52 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class
Nov 23, 2015 4:54:52 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class
Nov 23, 2015 4:54:52 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Nov 23, 2015 4:54:52 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Nov 23, 2015 4:54:52 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Nov 23, 2015 4:54:52 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Nov 23, 2015 4:54:52 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest"
Nov 23, 2015 4:54:52 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Nov 23, 2015 4:54:53 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class
Nov 23, 2015 4:54:53 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class
Nov 23, 2015 4:54:53 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Nov 23, 2015 4:54:53 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Nov 23, 2015 4:54:53 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Nov 23, 2015 4:54:53 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Nov 23, 2015 4:54:53 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Nov 23, 2015 4:54:53 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Nov 23, 2015 4:54:54 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
Nov 23, 2015 4:54:54 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Nov 23, 2015 4:54:54 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
Nov 23, 2015 4:54:54 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Nov 23, 2015 4:54:54 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Nov 23, 2015 4:54:54 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Nov 23, 2015 4:54:54 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Nov 23, 2015 4:54:54 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Nov 23, 2015 4:54:55 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
Nov 23, 2015 4:54:55 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Nov 23, 2015 4:54:55 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
Nov 23, 2015 4:54:55 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Nov 23, 2015 4:54:55 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Nov 23, 2015 4:54:55 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Nov 23, 2015 4:54:55 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Nov 23, 2015 4:54:55 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Nov 23, 2015 4:54:56 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
Nov 23, 2015 4:54:56 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Nov 23, 2015 4:54:56 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
Nov 23, 2015 4:54:56 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Nov 23, 2015 4:54:56 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Nov 23, 2015 4:54:56 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Nov 23, 2015 4:54:56 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Nov 23, 2015 4:54:56 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.