2015-11-23 17:06:47,697 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(195)) - found 1 test platforms from classpath
2015-11-23 17:06:47,709 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(244)) - adding test: cascading.scheme.hadoop.WritableSequenceFilePlatformTest, with platform: hadoop2-mr1
2015-11-23 17:06:47,721 INFO hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(136)) - using cluster
2015-11-23 17:06:48,300 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
2015-11-23 17:06:48,900 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(125)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2015-11-23 17:06:52,666 WARN containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-11-23 17:06:52,871 WARN containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-11-23 17:06:53,064 WARN containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-11-23 17:06:53,296 WARN containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-11-23 17:07:10,408 INFO platform.TestPlatform (TestPlatform.java:getGlobalProperties(73)) - platform property overrides:
2015-11-23 17:07:10,632 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 17:07:10,632 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 17:07:10,675 INFO property.AppProps (AppProps.java:getAppID(177)) - using app.id: 4D17C0B471BB423BA211D86E40689A52
2015-11-23 17:07:10,885 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.055
2015-11-23 17:07:10,887 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2015-11-23 17:07:10,889 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 17:07:11,003 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 17:07:11,003 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 17:07:11,027 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.019
2015-11-23 17:07:11,027 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2015-11-23 17:07:11,028 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 17:07:11,047 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-11-23 17:07:11,047 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /root/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-11-23 17:07:11,066 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.015
2015-11-23 17:07:11,067 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2015-11-23 17:07:11,067 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-11-23 17:07:11,084 INFO util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.0.2
2015-11-23 17:07:11,084 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] starting
2015-11-23 17:07:11,093 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] parallel execution of flows is enabled: true
2015-11-23 17:07:11,093 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] executing total flows: 3
2015-11-23 17:07:11,093 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] allocating management threads: 3
2015-11-23 17:07:11,094 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] starting flow: keyvalue
2015-11-23 17:07:11,095 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] at least one sink is marked for delete
2015-11-23 17:07:11,096 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] sink oldest modified date: Thu Jan 01 07:59:59 CST 1970
2015-11-23 17:07:11,124 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] starting
2015-11-23 17:07:11,125 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/classes/test/data/apache.10.txt"]
2015-11-23 17:07:11,125 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] sink: Hfs["WritableSequenceFile[['offset', 'line']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/keyvalue"]
2015-11-23 17:07:11,125 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] parallel execution of steps is enabled: true
2015-11-23 17:07:11,125 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] executing total steps: 1
2015-11-23 17:07:11,125 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] allocating management threads: 1
2015-11-23 17:07:11,127 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] starting step: (1/1) ...orm/testWritable/keyvalue
2015-11-23 17:07:12,042 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] submitted hadoop job: job_1448269624906_0001
2015-11-23 17:07:12,042 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] tracking url: http://shihc046-public.cn.ibm.com:46945/proxy/application_1448269624906_0001/
2015-11-23 17:07:21,385 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448269624906_0001_01_000003 is : 143
2015-11-23 17:07:21,486 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448269624906_0001_01_000005 is : 143
2015-11-23 17:07:21,514 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448269624906_0001_01_000002 is : 143
2015-11-23 17:07:22,439 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448269624906_0001_01_000004 is : 143
2015-11-23 17:07:23,686 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/keyvalue/_temporary
2015-11-23 17:07:23,690 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] completed in: 00:12.557, using cpu time: 00:06.110
2015-11-23 17:07:23,690 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] completed flow: keyvalue
2015-11-23 17:07:23,690 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] starting flow: key
2015-11-23 17:07:23,690 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] starting flow: value
2015-11-23 17:07:23,690 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] at least one sink is marked for delete
2015-11-23 17:07:23,691 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] sink oldest modified date: Thu Jan 01 07:59:59 CST 1970
2015-11-23 17:07:23,691 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] at least one sink is marked for delete
2015-11-23 17:07:23,691 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] sink oldest modified date: Thu Jan 01 07:59:59 CST 1970
2015-11-23 17:07:23,700 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] starting
2015-11-23 17:07:23,700 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] starting
2015-11-23 17:07:23,701 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] source: Hfs["WritableSequenceFile[['offset', 'line']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/keyvalue"]
2015-11-23 17:07:23,701 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] source: Hfs["WritableSequenceFile[['offset', 'line']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/keyvalue"]
2015-11-23 17:07:23,701 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] sink: Hfs["WritableSequenceFile[['line']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/value"]
2015-11-23 17:07:23,701 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] sink: Hfs["WritableSequenceFile[['offset']]"]["/root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/key"]
2015-11-23 17:07:23,701 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] parallel execution of steps is enabled: true
2015-11-23 17:07:23,701 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] parallel execution of steps is enabled: true
2015-11-23 17:07:23,701 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] executing total steps: 1
2015-11-23 17:07:23,702 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] allocating management threads: 1
2015-11-23 17:07:23,702 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] executing total steps: 1
2015-11-23 17:07:23,702 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] allocating management threads: 1
2015-11-23 17:07:23,703 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] starting step: (1/1) ...atform/testWritable/value
2015-11-23 17:07:23,705 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] starting step: (1/1) ...platform/testWritable/key
2015-11-23 17:07:23,913 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] submitted hadoop job: job_1448269624906_0002
2015-11-23 17:07:23,913 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] tracking url: http://shihc046-public.cn.ibm.com:46945/proxy/application_1448269624906_0002/
2015-11-23 17:07:23,927 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] submitted hadoop job: job_1448269624906_0003
2015-11-23 17:07:23,927 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] tracking url: http://shihc046-public.cn.ibm.com:46945/proxy/application_1448269624906_0003/
2015-11-23 17:07:37,486 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448269624906_0002_01_000004 is : 143
2015-11-23 17:07:37,508 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448269624906_0002_01_000005 is : 143
2015-11-23 17:07:37,535 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448269624906_0002_01_000002 is : 143
2015-11-23 17:07:38,704 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/value/_temporary
2015-11-23 17:07:38,708 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] completed in: 00:15.003, using cpu time: 00:03.070
2015-11-23 17:07:38,708 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] completed flow: value
2015-11-23 17:07:52,536 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448269624906_0003_01_000002 is : 143
2015-11-23 17:07:52,592 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448269624906_0003_01_000005 is : 143
2015-11-23 17:07:52,610 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448269624906_0003_01_000003 is : 143
2015-11-23 17:07:53,046 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1448269624906_0003_01_000004 is : 143
2015-11-23 17:07:54,294 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/key/_temporary
2015-11-23 17:07:54,299 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] completed in: 00:30.591, using cpu time: 00:03.290
2015-11-23 17:07:54,300 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] completed flow: key
2015-11-23 17:07:54,454 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/writablesequencefileplatform/testWritable/keyvalue
2015-11-23 17:07:54,468 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/writablesequencefileplatform/testWritable/value
2015-11-23 17:07:54,481 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /root/yuanbo/cascading.compatibility-3.0/biginsights-4.1/build/test/output//hadoop2-mr1/writablesequencefileplatform/testWritable/key