Class cascading.tap.hadoop.DistCacheTapPlatformTest

all > cascading.tap.hadoop > DistCacheTapPlatformTest

tests

failures

ignored

3m9.51s

duration

100%

successful

Tests
Standard output
Standard error

Tests

Test	Duration	Result
testDirectory	28.735s	passed
testGlobSupport	50.439s	passed
testHashJoinCheckpointWithDistCacheDecorator	54.102s	passed
testHashJoinDistCacheTapLHS	28.283s	passed
testHashJoinDistCacheTapRHS	27.948s	passed

Standard output

2016-05-18 12:06:08,980 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(197)) - found 1 test platforms from classpath
2016-05-18 12:06:09,008 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(246)) - adding test: cascading.tap.hadoop.DistCacheTapPlatformTest, with platform: hadoop2-mr1
2016-05-18 12:06:09,040 INFO  hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(136)) - using cluster
2016-05-18 12:06:10,192 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
2016-05-18 12:06:10,824 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(125)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2016-05-18 12:06:15,356 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-05-18 12:06:15,625 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-05-18 12:06:15,804 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-05-18 12:06:15,982 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2016-05-18 12:06:33,077 INFO  platform.TestPlatform (TestPlatform.java:getGlobalProperties(75)) - platform property overrides: 
2016-05-18 12:06:33,293 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 12:06:33,294 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(176)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.1.0/fdadb6ac788ea19f3412b9569a43a7635318b0c5/cascading-hadoop2-mr1-3.1.0.jar
2016-05-18 12:06:33,359 INFO  property.AppProps (AppProps.java:getAppID(177)) - using app.id: 4FCCCC74673E4FD8BDF5E35D1C0AA590
2016-05-18 12:06:33,524 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.116
2016-05-18 12:06:33,527 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-18 12:06:33,528 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 12:06:33,567 INFO  hadoop.BaseDistCacheTap (BaseDistCacheTap.java:registerURI(155)) - adding hdfs://localhost:59130/tmp/distcachetap812478828118973529056558451773116/upper_0.txt to local resource configuration 
2016-05-18 12:06:33,568 INFO  hadoop.BaseDistCacheTap (BaseDistCacheTap.java:registerURI(155)) - adding hdfs://localhost:59130/tmp/distcachetap812478828118973529056558451773116/upper_1.txt to local resource configuration 
2016-05-18 12:06:33,568 INFO  hadoop.BaseDistCacheTap (BaseDistCacheTap.java:registerURI(155)) - adding hdfs://localhost:59130/tmp/distcachetap812478828118973529056558451773116/upper_2.txt to local resource configuration 
2016-05-18 12:06:33,568 INFO  hadoop.BaseDistCacheTap (BaseDistCacheTap.java:registerURI(155)) - adding hdfs://localhost:59130/tmp/distcachetap812478828118973529056558451773116/upper_3.txt to local resource configuration 
2016-05-18 12:06:33,569 INFO  hadoop.BaseDistCacheTap (BaseDistCacheTap.java:registerURI(155)) - adding hdfs://localhost:59130/tmp/distcachetap812478828118973529056558451773116/upper_4.txt to local resource configuration 
2016-05-18 12:06:33,670 INFO  util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.1.0
2016-05-18 12:06:33,671 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] starting
2016-05-18 12:06:33,671 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/tmp/distcachetap812478828118973529056558451773116/*"]
2016-05-18 12:06:33,672 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/classes/test/data/lower.txt"]
2016-05-18 12:06:33,672 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/distcachetapplatform/testGlobSupport/testGlobSupportjoin"]
2016-05-18 12:06:33,673 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  parallel execution of steps is enabled: true
2016-05-18 12:06:33,673 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  executing total steps: 1
2016-05-18 12:06:33,674 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  allocating management threads: 1
2016-05-18 12:06:33,675 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] starting step: (1/1) ...pport/testGlobSupportjoin
2016-05-18 12:06:34,587 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] submitted hadoop job: job_1463573187575_0001
2016-05-18 12:06:34,587 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] tracking url: http://ip-10-158-37-203:48695/proxy/application_1463573187575_0001/
2016-05-18 12:06:57,676 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463573187575_0001_01_000003 is : 143
2016-05-18 12:06:57,736 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463573187575_0001_01_000002 is : 143
2016-05-18 12:06:57,809 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463573187575_0001_01_000005 is : 143
2016-05-18 12:06:57,862 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463573187575_0001_01_000004 is : 143
2016-05-18 12:06:58,097 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463573187575_0001_01_000006 is : 143
2016-05-18 12:06:59,360 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/distcachetapplatform/testGlobSupport/testGlobSupportjoin/_temporary
2016-05-18 12:06:59,362 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  completed in: 00:25.685, using cpu time: 00:07.930
2016-05-18 12:06:59,458 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output//hadoop2-mr1/distcachetapplatform/testGlobSupport/testGlobSupportjoin
2016-05-18 12:06:59,524 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 12:06:59,525 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(176)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.1.0/fdadb6ac788ea19f3412b9569a43a7635318b0c5/cascading-hadoop2-mr1-3.1.0.jar
2016-05-18 12:06:59,617 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.079
2016-05-18 12:06:59,619 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-18 12:06:59,619 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 12:06:59,624 INFO  hadoop.BaseDistCacheTap (BaseDistCacheTap.java:registerURI(155)) - adding /tmp/distcachetap861378789508109225556584800116421 to local resource configuration 
2016-05-18 12:06:59,644 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] starting
2016-05-18 12:06:59,644 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/tmp/distcachetap861378789508109225556584800116421"]
2016-05-18 12:06:59,645 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/classes/test/data/lower.txt"]
2016-05-18 12:06:59,645 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/distcachetapplatform/testDirectory/testDirectoryjoin"]
2016-05-18 12:06:59,645 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  parallel execution of steps is enabled: true
2016-05-18 12:06:59,645 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  executing total steps: 1
2016-05-18 12:06:59,645 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  allocating management threads: 1
2016-05-18 12:06:59,646 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] starting step: (1/1) ...rectory/testDirectoryjoin
2016-05-18 12:06:59,813 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] submitted hadoop job: job_1463573187575_0002
2016-05-18 12:06:59,814 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] tracking url: http://ip-10-158-37-203:48695/proxy/application_1463573187575_0002/
2016-05-18 12:07:26,278 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463573187575_0002_01_000002 is : 143
2016-05-18 12:07:26,381 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463573187575_0002_01_000003 is : 143
2016-05-18 12:07:26,665 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463573187575_0002_01_000004 is : 143
2016-05-18 12:07:26,872 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463573187575_0002_01_000005 is : 143
2016-05-18 12:07:26,903 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463573187575_0002_01_000006 is : 143
2016-05-18 12:07:28,117 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/distcachetapplatform/testDirectory/testDirectoryjoin/_temporary
2016-05-18 12:07:28,119 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  completed in: 00:28.470, using cpu time: 00:06.520
2016-05-18 12:07:28,195 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output//hadoop2-mr1/distcachetapplatform/testDirectory/testDirectoryjoin
2016-05-18 12:07:28,254 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 12:07:28,255 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(176)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.1.0/fdadb6ac788ea19f3412b9569a43a7635318b0c5/cascading-hadoop2-mr1-3.1.0.jar
2016-05-18 12:07:28,282 INFO  planner.FlowPlanner (FlowPlanner.java:decorateTap(798)) - found decorator: cascading.flowconnector.checkpoint_tap.decorator.classname, wrapping tap: TempHfs["null"][1930304679/upper/]
2016-05-18 12:07:28,360 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.097
2016-05-18 12:07:28,362 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 2, nodes: 2
2016-05-18 12:07:28,363 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 12:07:28,380 INFO  hadoop.BaseDistCacheTap (BaseDistCacheTap.java:registerURI(155)) - adding /tmp/hadoop-teamcity/1930304679_upper_BB50F6F7A7BC43F6B40F1AA2F3DB4739 to local resource configuration 
2016-05-18 12:07:28,394 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper] starting
2016-05-18 12:07:28,394 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/classes/test/data/upper.txt"]
2016-05-18 12:07:28,394 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/classes/test/data/lower.txt"]
2016-05-18 12:07:28,395 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper]  sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/distcachetapplatform/testHashJoinCheckpointWithDistCacheDecorator/join"]
2016-05-18 12:07:28,395 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper]  parallel execution of steps is enabled: true
2016-05-18 12:07:28,395 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper]  executing total steps: 2
2016-05-18 12:07:28,395 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper]  allocating management threads: 2
2016-05-18 12:07:28,396 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper] starting step: (1/2)
2016-05-18 12:07:28,587 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper] submitted hadoop job: job_1463573187575_0003
2016-05-18 12:07:28,588 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper] tracking url: http://ip-10-158-37-203:48695/proxy/application_1463573187575_0003/
2016-05-18 12:07:53,363 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463573187575_0003_01_000003 is : 143
2016-05-18 12:07:53,532 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463573187575_0003_01_000005 is : 143
2016-05-18 12:07:53,577 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463573187575_0003_01_000004 is : 143
2016-05-18 12:07:54,037 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463573187575_0003_01_000006 is : 143
2016-05-18 12:07:55,192 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper] starting step: (2/2) ...thDistCacheDecorator/join
2016-05-18 12:07:55,332 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper] submitted hadoop job: job_1463573187575_0004
2016-05-18 12:07:55,332 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper] tracking url: http://ip-10-158-37-203:48695/proxy/application_1463573187575_0004/
2016-05-18 12:08:20,105 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463573187575_0004_01_000006 is : 143
2016-05-18 12:08:20,750 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463573187575_0004_01_000003 is : 143
2016-05-18 12:08:20,828 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463573187575_0004_01_000002 is : 143
2016-05-18 12:08:20,987 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463573187575_0004_01_000005 is : 143
2016-05-18 12:08:21,045 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463573187575_0004_01_000004 is : 143
2016-05-18 12:08:22,245 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/distcachetapplatform/testHashJoinCheckpointWithDistCacheDecorator/join/_temporary
2016-05-18 12:08:22,246 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [lower*upper]  completed in: 00:53.846, using cpu time: 00:12.740
2016-05-18 12:08:22,300 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output//hadoop2-mr1/distcachetapplatform/testHashJoinCheckpointWithDistCacheDecorator/join
2016-05-18 12:08:22,333 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 12:08:22,334 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(176)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.1.0/fdadb6ac788ea19f3412b9569a43a7635318b0c5/cascading-hadoop2-mr1-3.1.0.jar
2016-05-18 12:08:22,383 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.045
2016-05-18 12:08:22,385 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-18 12:08:22,385 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 12:08:22,388 INFO  hadoop.BaseDistCacheTap (BaseDistCacheTap.java:sourceConfInit(65)) - can't use distributed cache. reading '/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/classes/test/data/lower.txt' from hdfs
2016-05-18 12:08:22,401 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] starting
2016-05-18 12:08:22,402 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/classes/test/data/upper.txt"]
2016-05-18 12:08:22,402 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/classes/test/data/lower.txt"]
2016-05-18 12:08:22,403 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/distcachetapplatform/testHashJoinDistCacheTapLHS/testHashJoinDistCacheTapLHSjoin"]
2016-05-18 12:08:22,403 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  parallel execution of steps is enabled: true
2016-05-18 12:08:22,403 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  executing total steps: 1
2016-05-18 12:08:22,404 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  allocating management threads: 1
2016-05-18 12:08:22,405 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] starting step: (1/1) ...shJoinDistCacheTapLHSjoin
2016-05-18 12:08:22,563 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] submitted hadoop job: job_1463573187575_0005
2016-05-18 12:08:22,564 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] tracking url: http://ip-10-158-37-203:48695/proxy/application_1463573187575_0005/
2016-05-18 12:08:48,218 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463573187575_0005_01_000006 is : 143
2016-05-18 12:08:48,389 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463573187575_0005_01_000002 is : 143
2016-05-18 12:08:48,499 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463573187575_0005_01_000005 is : 143
2016-05-18 12:08:48,908 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463573187575_0005_01_000004 is : 143
2016-05-18 12:08:49,322 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463573187575_0005_01_000003 is : 143
2016-05-18 12:08:50,529 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/distcachetapplatform/testHashJoinDistCacheTapLHS/testHashJoinDistCacheTapLHSjoin/_temporary
2016-05-18 12:08:50,531 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  completed in: 00:28.126, using cpu time: 00:05.810
2016-05-18 12:08:50,587 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output//hadoop2-mr1/distcachetapplatform/testHashJoinDistCacheTapLHS/testHashJoinDistCacheTapLHSjoin
2016-05-18 12:08:50,616 INFO  util.Util (Util.java:findMainClass(1374)) - using default application jar, may cause class not found exceptions on the cluster
2016-05-18 12:08:50,617 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(176)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.1.0/fdadb6ac788ea19f3412b9569a43a7635318b0c5/cascading-hadoop2-mr1-3.1.0.jar
2016-05-18 12:08:50,667 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.046
2016-05-18 12:08:50,669 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2016-05-18 12:08:50,669 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2016-05-18 12:08:50,672 INFO  hadoop.BaseDistCacheTap (BaseDistCacheTap.java:registerURI(155)) - adding /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/classes/test/data/upper.txt to local resource configuration 
2016-05-18 12:08:50,683 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] starting
2016-05-18 12:08:50,683 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/classes/test/data/upper.txt"]
2016-05-18 12:08:50,684 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/classes/test/data/lower.txt"]
2016-05-18 12:08:50,684 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  sink: Hfs["TextLine[['line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/distcachetapplatform/testHashJoinDistCacheTapRHS/testHashJoinDistCacheTapRHSjoin"]
2016-05-18 12:08:50,684 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  parallel execution of steps is enabled: true
2016-05-18 12:08:50,684 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  executing total steps: 1
2016-05-18 12:08:50,684 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  allocating management threads: 1
2016-05-18 12:08:50,685 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] starting step: (1/1) ...shJoinDistCacheTapRHSjoin
2016-05-18 12:08:50,803 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] submitted hadoop job: job_1463573187575_0006
2016-05-18 12:08:50,803 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test] tracking url: http://ip-10-158-37-203:48695/proxy/application_1463573187575_0006/
2016-05-18 12:09:15,983 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463573187575_0006_01_000006 is : 143
2016-05-18 12:09:16,974 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463573187575_0006_01_000004 is : 143
2016-05-18 12:09:17,030 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463573187575_0006_01_000005 is : 143
2016-05-18 12:09:17,132 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463573187575_0006_01_000002 is : 143
2016-05-18 12:09:17,291 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(224)) - Exit code from container container_1463573187575_0006_01_000003 is : 143
2016-05-18 12:09:18,478 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output/hadoop2-mr1/distcachetapplatform/testHashJoinDistCacheTapRHS/testHashJoinDistCacheTapRHSjoin/_temporary
2016-05-18 12:09:18,480 INFO  flow.Flow (BaseFlow.java:logInfo(1504)) - [distcache test]  completed in: 00:27.793, using cpu time: 00:06.540
2016-05-18 12:09:18,535 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /opt/buildAgent-8.0.3/work/9c1cc778dcd1fc2f/apache-2.7.x/build/test/output//hadoop2-mr1/distcachetapplatform/testHashJoinDistCacheTapRHS/testHashJoinDistCacheTapRHSjoin

Standard error

May 18, 2016 12:06:26 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class
May 18, 2016 12:06:26 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class
May 18, 2016 12:06:26 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 18, 2016 12:06:26 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 18, 2016 12:06:26 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 12:06:26 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 12:06:27 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest"
May 18, 2016 12:06:27 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 18, 2016 12:06:27 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class
May 18, 2016 12:06:27 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class
May 18, 2016 12:06:27 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 18, 2016 12:06:27 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 18, 2016 12:06:27 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 12:06:28 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 12:06:28 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 12:06:29 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 18, 2016 12:06:29 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
May 18, 2016 12:06:29 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 18, 2016 12:06:29 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
May 18, 2016 12:06:29 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 18, 2016 12:06:29 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 12:06:29 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 12:06:29 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 12:06:30 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 18, 2016 12:06:30 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
May 18, 2016 12:06:30 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 18, 2016 12:06:30 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
May 18, 2016 12:06:30 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 18, 2016 12:06:30 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 12:06:30 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 12:06:30 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 12:06:31 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 18, 2016 12:06:31 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
May 18, 2016 12:06:31 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 18, 2016 12:06:31 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
May 18, 2016 12:06:31 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 18, 2016 12:06:31 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 12:06:31 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 12:06:31 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 12:06:32 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 18, 2016 12:06:32 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
May 18, 2016 12:06:32 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 18, 2016 12:06:32 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
May 18, 2016 12:06:32 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 18, 2016 12:06:32 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 12:06:32 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 18, 2016 12:06:32 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"