2015-11-23 16:50:45,929 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(195)) - found 1 test platforms from classpath
2015-11-23 16:50:45,943 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(244)) - adding test: cascading.tap.TapPlatformTest, with platform: hadoop2-mr1
2015-11-23 16:50:45,956 INFO hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(136)) - using cluster
2015-11-23 16:50:46,547 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
2015-11-23 16:50:47,148 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(125)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2015-11-23 16:50:51,014 WARN containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-11-23 16:50:51,226 WARN containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-11-23 16:50:51,415 WARN containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-11-23 16:50:51,695 WARN containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-11-23 16:51:08,789 INFO platform.TestPlatform (TestPlatform.java:getGlobalProperties(73)) - platform property overrides:
2015-11-23 16:51:08,955 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:51:08,955 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:51:08,997 INFO property.AppProps (AppProps.java:getAppID(177)) - using app.id: 4A7F5EE8D180449D984D531DAFD47D18
2015-11-23 16:51:09,072 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [partition] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.043
2015-11-23 16:51:09,074 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [partition] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2015-11-23 16:51:09,076 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [partition] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:51:09,330 INFO util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.0.2
2015-11-23 16:51:09,332 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [partition] starting
2015-11-23 16:51:09,333 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [partition] source: Hfs["TextDelimited[['number', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross-x2.txt"]
2015-11-23 16:51:09,333 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [partition] sink: PartitionTap["Hfs["TextDelimited[['upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/tapplatform/testPartitionTapTextDelimited/partitioned"]"]["cascading.tap.partition.DelimitedPartition@32a7a2af"]
2015-11-23 16:51:09,334 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [partition] parallel execution of steps is enabled: true
2015-11-23 16:51:09,335 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [partition] executing total steps: 1
2015-11-23 16:51:09,335 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [partition] allocating management threads: 1
2015-11-23 16:51:09,337 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [partition] starting step: (1/1) ...TextDelimited/partitioned
2015-11-23 16:51:10,221 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [partition] submitted hadoop job: job_1448268663285_0001
2015-11-23 16:51:10,221 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [partition] tracking url: http://shihc046-public.cn.ibm.com:59863/proxy/application_1448268663285_0001/
2015-11-23 16:51:19,020 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268663285_0001_01_000002 is : 143
2015-11-23 16:51:19,052 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268663285_0001_01_000003 is : 143
2015-11-23 16:51:19,374 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268663285_0001_01_000004 is : 143
2015-11-23 16:51:19,441 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268663285_0001_01_000005 is : 143
2015-11-23 16:51:20,649 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/tapplatform/testPartitionTapTextDelimited/partitioned/_temporary
2015-11-23 16:51:20,655 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [partition] completed in: 00:11.311, using cpu time: 00:04.400
2015-11-23 16:51:20,676 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:51:20,676 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:51:20,698 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [copy] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.017
2015-11-23 16:51:20,699 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [copy] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2015-11-23 16:51:20,699 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [copy] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:51:20,721 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [copy] starting
2015-11-23 16:51:20,722 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [copy] source: PartitionTap["Hfs["TextDelimited[['upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/tapplatform/testPartitionTapTextDelimited/partitioned"]"]["cascading.tap.partition.DelimitedPartition@32a7a2af"]
2015-11-23 16:51:20,722 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [copy] sink: Hfs["TextDelimited[['number', 'lower', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/tapplatform/testPartitionTapTextDelimited/final"]
2015-11-23 16:51:20,723 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [copy] parallel execution of steps is enabled: true
2015-11-23 16:51:20,723 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [copy] executing total steps: 1
2015-11-23 16:51:20,723 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [copy] allocating management threads: 1
2015-11-23 16:51:20,724 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [copy] starting step: (1/1) ...ionTapTextDelimited/final
2015-11-23 16:51:20,929 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [copy] submitted hadoop job: job_1448268663285_0002
2015-11-23 16:51:20,929 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [copy] tracking url: http://shihc046-public.cn.ibm.com:59863/proxy/application_1448268663285_0002/
2015-11-23 16:51:39,972 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268663285_0002_01_000009 is : 143
2015-11-23 16:51:41,304 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268663285_0002_01_000012 is : 143
2015-11-23 16:51:41,702 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268663285_0002_01_000003 is : 143
2015-11-23 16:51:41,847 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268663285_0002_01_000005 is : 143
2015-11-23 16:51:41,941 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268663285_0002_01_000014 is : 143
2015-11-23 16:51:42,202 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268663285_0002_01_000015 is : 143
2015-11-23 16:51:44,015 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268663285_0002_01_000016 is : 143
2015-11-23 16:51:44,847 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1080)) - Event EventType: KILL_CONTAINER sent to absent container container_1448268663285_0002_01_000028
2015-11-23 16:51:45,163 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1080)) - Event EventType: KILL_CONTAINER sent to absent container container_1448268663285_0002_01_000029
2015-11-23 16:51:46,969 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268663285_0002_01_000018 is : 143
2015-11-23 16:51:48,092 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268663285_0002_01_000019 is : 143
2015-11-23 16:51:48,282 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268663285_0002_01_000020 is : 143
2015-11-23 16:51:49,081 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268663285_0002_01_000027 is : 143
2015-11-23 16:51:49,105 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268663285_0002_01_000024 is : 143
2015-11-23 16:51:49,124 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268663285_0002_01_000025 is : 143
2015-11-23 16:51:49,164 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268663285_0002_01_000023 is : 143
2015-11-23 16:51:49,420 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268663285_0002_01_000026 is : 143
2015-11-23 16:51:50,670 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/tapplatform/testPartitionTapTextDelimited/final/_temporary
2015-11-23 16:51:50,675 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [copy] completed in: 00:29.942, using cpu time: 00:22.650
2015-11-23 16:51:51,045 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/tapplatform/testPartitionTapTextDelimited/partitioned
2015-11-23 16:51:51,096 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/tapplatform/testPartitionTapTextDelimited/final
2015-11-23 16:51:51,227 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:51:51,227 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:51:51,257 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.025
2015-11-23 16:51:51,257 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-11-23 16:51:51,257 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:51:51,280 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] starting
2015-11-23 16:51:51,280 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs.txt"]
2015-11-23 16:51:51,281 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] sink: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/tapplatform/testSideFileCollector/sidefile/direct"]
2015-11-23 16:51:51,281 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] parallel execution of steps is enabled: true
2015-11-23 16:51:51,281 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] executing total steps: 1
2015-11-23 16:51:51,281 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] allocating management threads: 1
2015-11-23 16:51:51,282 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] starting step: (1/1) ...Collector/sidefile/direct
2015-11-23 16:51:51,401 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] submitted hadoop job: job_1448268663285_0003
2015-11-23 16:51:51,401 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] tracking url: http://shihc046-public.cn.ibm.com:59863/proxy/application_1448268663285_0003/
2015-11-23 16:52:05,108 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268663285_0003_01_000004 is : 143
2015-11-23 16:52:05,131 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268663285_0003_01_000005 is : 143
2015-11-23 16:52:05,164 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268663285_0003_01_000002 is : 143
2015-11-23 16:52:05,216 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268663285_0003_01_000003 is : 143
2015-11-23 16:52:10,248 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268663285_0003_01_000006 is : 143
2015-11-23 16:52:11,433 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/tapplatform/testSideFileCollector/sidefile/direct/_temporary
2015-11-23 16:52:11,437 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] completed in: 00:20.152, using cpu time: 00:03.770
2015-11-23 16:52:11,489 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/tapplatform/testSideFileCollector/sidefile/direct
2015-11-23 16:52:11,494 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/tapplatform/testSideFileCollector/sidefile/indirect
2015-11-23 16:52:11,531 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:52:11,531 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:52:11,548 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.013
2015-11-23 16:52:11,549 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2015-11-23 16:52:11,549 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:52:11,558 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] starting
2015-11-23 16:52:11,559 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/unexpectedEndOfFile.gz"]
2015-11-23 16:52:11,559 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/tapplatform/testTupleEntrySchemeIteratorExceptionHandling/testTupleEntrySchemeIteratorExceptionHandling"]
2015-11-23 16:52:11,559 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] parallel execution of steps is enabled: true
2015-11-23 16:52:11,559 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] executing total steps: 1
2015-11-23 16:52:11,559 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] allocating management threads: 1
2015-11-23 16:52:11,560 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] starting step: (1/1) ...IteratorExceptionHandling
2015-11-23 16:52:11,680 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] submitted hadoop job: job_1448268663285_0004
2015-11-23 16:52:11,680 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] tracking url: http://shihc046-public.cn.ibm.com:59863/proxy/application_1448268663285_0004/
2015-11-23 16:52:25,755 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268663285_0004_01_000002 is : 143
2015-11-23 16:52:26,935 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/tapplatform/testTupleEntrySchemeIteratorExceptionHandling/testTupleEntrySchemeIteratorExceptionHandling/_temporary
2015-11-23 16:52:26,938 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] completed in: 00:15.374, using cpu time: 00:00.890
2015-11-23 16:52:26,971 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/tapplatform/testTupleEntrySchemeIteratorExceptionHandling/testTupleEntrySchemeIteratorExceptionHandling
2015-11-23 16:52:27,009 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:52:27,009 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:52:27,025 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.012
2015-11-23 16:52:27,026 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2015-11-23 16:52:27,026 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:52:27,037 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] starting
2015-11-23 16:52:27,037 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] source: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 16:52:27,037 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] sink: Hfs["TextLine[['line']->['second', 'first', 'third']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/tapplatform/testSinkDeclaredFields/declaredsinks"]
2015-11-23 16:52:27,038 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] parallel execution of steps is enabled: true
2015-11-23 16:52:27,038 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] executing total steps: 1
2015-11-23 16:52:27,038 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] allocating management threads: 1
2015-11-23 16:52:27,039 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] starting step: (1/1) ...laredFields/declaredsinks
2015-11-23 16:52:27,172 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] submitted hadoop job: job_1448268663285_0005
2015-11-23 16:52:27,172 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] tracking url: http://shihc046-public.cn.ibm.com:59863/proxy/application_1448268663285_0005/
2015-11-23 16:52:40,598 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268663285_0005_01_000002 is : 143
2015-11-23 16:52:40,887 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268663285_0005_01_000004 is : 143
2015-11-23 16:52:40,925 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268663285_0005_01_000005 is : 143
2015-11-23 16:52:41,671 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268663285_0005_01_000003 is : 143
2015-11-23 16:52:42,844 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/tapplatform/testSinkDeclaredFields/declaredsinks/_temporary
2015-11-23 16:52:42,849 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] completed in: 00:15.806, using cpu time: 00:03.210
2015-11-23 16:52:42,955 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/tapplatform/testSinkDeclaredFields/declaredsinks
2015-11-23 16:52:43,019 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:52:43,020 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:52:43,038 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.014
2015-11-23 16:52:43,038 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2015-11-23 16:52:43,039 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:52:43,056 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] starting
2015-11-23 16:52:43,057 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] source: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lower+upper.txt"]
2015-11-23 16:52:43,057 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] sink: MultiSinkTap[[Hfs["TextLine[['offset', 'line']->['number', 'lower']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/tapplatform/testMultiSinkTap/multisink/lhs"], Hfs["TextLine[['offset', 'line']->['number', 'upper']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/tapplatform/testMultiSinkTap/multisink/rhs"]]]
2015-11-23 16:52:43,057 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] parallel execution of steps is enabled: true
2015-11-23 16:52:43,057 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] executing total steps: 1
2015-11-23 16:52:43,057 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] allocating management threads: 1
2015-11-23 16:52:43,059 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] starting step: (1/1) ...6163E497FB583AD038BAF1AD2
2015-11-23 16:52:43,394 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] submitted hadoop job: job_1448268663285_0006
2015-11-23 16:52:43,395 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] tracking url: http://shihc046-public.cn.ibm.com:59863/proxy/application_1448268663285_0006/
2015-11-23 16:52:57,382 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268663285_0006_01_000006 is : 143
2015-11-23 16:52:57,517 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268663285_0006_01_000003 is : 143
2015-11-23 16:52:57,553 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268663285_0006_01_000005 is : 143
2015-11-23 16:52:57,554 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268663285_0006_01_000002 is : 143
2015-11-23 16:52:57,572 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268663285_0006_01_000004 is : 143
2015-11-23 16:52:58,715 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] completed in: 00:15.654, using cpu time: 00:04.380
2015-11-23 16:52:58,761 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/tapplatform/testMultiSinkTap/multisink/lhs
2015-11-23 16:52:58,772 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/tapplatform/testMultiSinkTap/multisink/rhs
2015-11-23 16:52:58,799 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:52:58,799 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:52:58,819 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.016
2015-11-23 16:52:58,820 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2015-11-23 16:52:58,820 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:52:58,831 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] starting
2015-11-23 16:52:58,832 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] source: Hfs["TextLine[['line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/lhs+rhs-cross.txt"]
2015-11-23 16:52:58,832 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] sink: Hfs["TextDelimited[['first', 'second', 'third']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/tapplatform/testSinkUnknown/unknownsinks"]
2015-11-23 16:52:58,832 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] parallel execution of steps is enabled: true
2015-11-23 16:52:58,832 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] executing total steps: 1
2015-11-23 16:52:58,832 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] allocating management threads: 1
2015-11-23 16:52:58,833 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] starting step: (1/1) ...tSinkUnknown/unknownsinks
2015-11-23 16:52:59,150 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] submitted hadoop job: job_1448268663285_0007
2015-11-23 16:52:59,150 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] tracking url: http://shihc046-public.cn.ibm.com:59863/proxy/application_1448268663285_0007/
2015-11-23 16:53:13,019 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268663285_0007_01_000005 is : 143
2015-11-23 16:53:13,045 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268663285_0007_01_000003 is : 143
2015-11-23 16:53:13,062 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268663285_0007_01_000002 is : 143
2015-11-23 16:53:13,107 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268663285_0007_01_000004 is : 143
2015-11-23 16:53:14,362 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/tapplatform/testSinkUnknown/unknownsinks/_temporary
2015-11-23 16:53:14,364 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [test] completed in: 00:15.529, using cpu time: 00:03.360
2015-11-23 16:53:14,432 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/tapplatform/testSinkUnknown/unknownsinks
2015-11-23 16:53:14,453 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 16:53:14,454 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 16:53:14,469 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.011
2015-11-23 16:53:14,469 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2015-11-23 16:53:14,469 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 16:53:14,478 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] starting
2015-11-23 16:53:14,478 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/unexpectedEndOfFile.gz"]
2015-11-23 16:53:14,478 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/tapplatform/testTupleEntrySchemeIteratorEOFException/testTupleEntrySchemeIteratorEOFException"]
2015-11-23 16:53:14,478 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] parallel execution of steps is enabled: true
2015-11-23 16:53:14,478 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] executing total steps: 1
2015-11-23 16:53:14,479 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] allocating management threads: 1
2015-11-23 16:53:14,480 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] starting step: (1/1) ...chemeIteratorEOFException
2015-11-23 16:53:14,533 WARN blockmanagement.BlockPlacementPolicy (BlockPlacementPolicyDefault.java:chooseTarget(382)) - Failed to place enough replicas, still in need of 1 to reach 4 (unavailableStorages=[], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}, newBlock=true) For more information, please enable DEBUG log level on org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicy
2015-11-23 16:53:14,534 WARN protocol.BlockStoragePolicy (BlockStoragePolicy.java:chooseStorageTypes(160)) - Failed to place enough replicas: expected size is 1 but only 0 storage types can be selected (replication=4, selected=[], unavailable=[DISK], removed=[DISK], policy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]})
2015-11-23 16:53:14,534 WARN blockmanagement.BlockPlacementPolicy (BlockPlacementPolicyDefault.java:chooseTarget(382)) - Failed to place enough replicas, still in need of 1 to reach 4 (unavailableStorages=[DISK], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}, newBlock=true) All required storage types are unavailable: unavailableStorages=[DISK], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}
2015-11-23 16:53:14,590 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] submitted hadoop job: job_1448268663285_0008
2015-11-23 16:53:14,591 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] tracking url: http://shihc046-public.cn.ibm.com:59863/proxy/application_1448268663285_0008/
2015-11-23 16:53:14,978 WARN blockmanagement.BlockPlacementPolicy (BlockPlacementPolicyDefault.java:chooseTarget(382)) - Failed to place enough replicas, still in need of 1 to reach 4 (unavailableStorages=[], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}, newBlock=false) For more information, please enable DEBUG log level on org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicy
2015-11-23 16:53:14,979 WARN blockmanagement.BlockPlacementPolicy (BlockPlacementPolicyDefault.java:chooseTarget(382)) - Failed to place enough replicas, still in need of 1 to reach 4 (unavailableStorages=[DISK], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}, newBlock=false) For more information, please enable DEBUG log level on org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicy
2015-11-23 16:53:14,979 WARN protocol.BlockStoragePolicy (BlockStoragePolicy.java:chooseStorageTypes(160)) - Failed to place enough replicas: expected size is 1 but only 0 storage types can be selected (replication=4, selected=[], unavailable=[DISK, ARCHIVE], removed=[DISK], policy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]})
2015-11-23 16:53:14,979 WARN blockmanagement.BlockPlacementPolicy (BlockPlacementPolicyDefault.java:chooseTarget(382)) - Failed to place enough replicas, still in need of 1 to reach 4 (unavailableStorages=[DISK, ARCHIVE], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}, newBlock=false) All required storage types are unavailable: unavailableStorages=[DISK, ARCHIVE], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}
2015-11-23 16:53:27,155 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268663285_0008_01_000002 is : 143
2015-11-23 16:53:31,253 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268663285_0008_01_000003 is : 143
2015-11-23 16:53:34,770 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268663285_0008_01_000004 is : 143
2015-11-23 16:53:38,760 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448268663285_0008_01_000005 is : 143
2015-11-23 16:53:39,876 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [] hadoop job job_1448268663285_0008 state at FAILED
2015-11-23 16:53:39,877 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [] failure info: Task failed task_1448268663285_0008_m_000000
Job failed as tasks failed. failedMaps:1 failedReduces:0
2015-11-23 16:53:39,903 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [] task completion events identify failed tasks
2015-11-23 16:53:39,903 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [] task completion events count: 4
2015-11-23 16:53:39,904 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [] event = Task Id : attempt_1448268663285_0008_m_000000_0, Status : FAILED
2015-11-23 16:53:39,904 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [] event = Task Id : attempt_1448268663285_0008_m_000000_1, Status : FAILED
2015-11-23 16:53:39,904 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [] event = Task Id : attempt_1448268663285_0008_m_000000_2, Status : FAILED
2015-11-23 16:53:39,905 WARN flow.Flow (BaseFlow.java:logWarn(1445)) - [] event = Task Id : attempt_1448268663285_0008_m_000000_3, Status : TIPFAILED
2015-11-23 16:53:39,929 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] stopping all jobs
2015-11-23 16:53:39,931 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] stopping: (1/1) ...chemeIteratorEOFException
2015-11-23 16:53:39,937 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] stopped all jobs
2015-11-23 16:53:39,939 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/tapplatform/testTupleEntrySchemeIteratorEOFException/testTupleEntrySchemeIteratorEOFException/_temporary
2015-11-23 16:53:39,945 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [] completed in: 00:25.459
2015-11-23 16:53:39,945 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/tapplatform/testTupleEntrySchemeIteratorEOFException/testTupleEntrySchemeIteratorEOFException