2015-09-24 14:16:01,215 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(195)) - found 1 test platforms from classpath
2015-09-24 14:16:01,250 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(244)) - adding test: cascading.scheme.hadoop.WritableSequenceFilePlatformTest, with platform: hadoop2-mr1
2015-09-24 14:16:01,270 INFO hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(136)) - using cluster
2015-09-24 14:16:13,596 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
2015-09-24 14:16:14,220 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2015-09-24 14:16:18,974 WARN fair.AllocationFileLoaderService (AllocationFileLoaderService.java:getAllocationFile(179)) - fair-scheduler.xml not found on the classpath.
2015-09-24 14:16:19,474 WARN containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-09-24 14:16:19,864 WARN containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-09-24 14:16:20,169 WARN containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-09-24 14:16:20,528 WARN containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-09-24 14:16:37,732 INFO platform.TestPlatform (TestPlatform.java:getGlobalProperties(73)) - platform property overrides:
2015-09-24 14:16:37,941 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-09-24 14:16:37,942 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /Users/ryan/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-09-24 14:16:38,006 INFO property.AppProps (AppProps.java:getAppID(177)) - using app.id: DCC965D87B3A4E61B3419CA63E81FF7C
2015-09-24 14:16:38,125 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.081
2015-09-24 14:16:38,128 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2015-09-24 14:16:38,130 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-09-24 14:16:38,251 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-09-24 14:16:38,251 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /Users/ryan/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-09-24 14:16:38,294 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.035
2015-09-24 14:16:38,296 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2015-09-24 14:16:38,296 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-09-24 14:16:38,327 INFO util.Util (Util.java:findMainClass(1327)) - using default application jar, may cause class not found exceptions on the cluster
2015-09-24 14:16:38,328 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /Users/ryan/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.2/a7e0a109fe1f98639fc92e32694f202ce66d81a8/cascading-hadoop2-mr1-3.0.2.jar
2015-09-24 14:16:38,369 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.034
2015-09-24 14:16:38,372 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2015-09-24 14:16:38,372 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-09-24 14:16:38,392 INFO util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 3.0.2
2015-09-24 14:16:38,392 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] starting
2015-09-24 14:16:38,397 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] parallel execution of flows is enabled: true
2015-09-24 14:16:38,397 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] executing total flows: 3
2015-09-24 14:16:38,397 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] allocating management threads: 3
2015-09-24 14:16:38,398 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] starting flow: keyvalue
2015-09-24 14:16:38,399 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] at least one sink is marked for delete
2015-09-24 14:16:38,399 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] sink oldest modified date: Wed Dec 31 18:59:59 EST 1969
2015-09-24 14:16:38,429 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] starting
2015-09-24 14:16:38,430 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/classes/test/data/apache.10.txt"]
2015-09-24 14:16:38,431 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] sink: Hfs["WritableSequenceFile[['offset', 'line']]"]["/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/keyvalue"]
2015-09-24 14:16:38,431 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] parallel execution of steps is enabled: true
2015-09-24 14:16:38,431 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] executing total steps: 1
2015-09-24 14:16:38,431 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] allocating management threads: 1
2015-09-24 14:16:38,433 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] starting step: (1/1) ...orm/testWritable/keyvalue
2015-09-24 14:16:39,523 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] submitted hadoop job: job_1443118592213_0001
2015-09-24 14:16:39,523 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] tracking url: http://localhost:64464/proxy/application_1443118592213_0001/
2015-09-24 14:17:24,813 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1443118592213_0001_01_000003 is : 143
2015-09-24 14:17:24,867 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1443118592213_0001_01_000005 is : 143
2015-09-24 14:17:25,203 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1443118592213_0001_01_000002 is : 143
2015-09-24 14:17:25,278 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1443118592213_0001_01_000004 is : 143
2015-09-24 14:17:26,730 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/keyvalue/_temporary
2015-09-24 14:17:26,734 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [keyvalue] completed in: 00:48.292
2015-09-24 14:17:26,734 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] completed flow: keyvalue
2015-09-24 14:17:26,735 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] starting flow: value
2015-09-24 14:17:26,735 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] starting flow: key
2015-09-24 14:17:26,735 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] at least one sink is marked for delete
2015-09-24 14:17:26,736 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] at least one sink is marked for delete
2015-09-24 14:17:26,736 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] sink oldest modified date: Wed Dec 31 18:59:59 EST 1969
2015-09-24 14:17:26,736 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] sink oldest modified date: Wed Dec 31 18:59:59 EST 1969
2015-09-24 14:17:26,748 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] starting
2015-09-24 14:17:26,748 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] starting
2015-09-24 14:17:26,749 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] source: Hfs["WritableSequenceFile[['offset', 'line']]"]["/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/keyvalue"]
2015-09-24 14:17:26,750 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] source: Hfs["WritableSequenceFile[['offset', 'line']]"]["/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/keyvalue"]
2015-09-24 14:17:26,750 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] sink: Hfs["WritableSequenceFile[['line']]"]["/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/value"]
2015-09-24 14:17:26,750 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] parallel execution of steps is enabled: true
2015-09-24 14:17:26,750 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] executing total steps: 1
2015-09-24 14:17:26,750 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] allocating management threads: 1
2015-09-24 14:17:26,750 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] sink: Hfs["WritableSequenceFile[['offset']]"]["/Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/key"]
2015-09-24 14:17:26,750 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] parallel execution of steps is enabled: true
2015-09-24 14:17:26,750 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] executing total steps: 1
2015-09-24 14:17:26,751 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] allocating management threads: 1
2015-09-24 14:17:26,753 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] starting step: (1/1) ...atform/testWritable/value
2015-09-24 14:17:26,753 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] starting step: (1/1) ...platform/testWritable/key
2015-09-24 14:17:27,157 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] submitted hadoop job: job_1443118592213_0003
2015-09-24 14:17:27,157 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] tracking url: http://localhost:64464/proxy/application_1443118592213_0003/
2015-09-24 14:17:27,162 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] submitted hadoop job: job_1443118592213_0002
2015-09-24 14:17:27,163 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] tracking url: http://localhost:64464/proxy/application_1443118592213_0002/
2015-09-24 14:17:54,899 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1065)) - Event EventType: KILL_CONTAINER sent to absent container container_1443118592213_0003_01_000006
2015-09-24 14:17:54,904 WARN containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1065)) - Event EventType: KILL_CONTAINER sent to absent container container_1443118592213_0002_01_000006
2015-09-24 14:18:26,402 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1443118592213_0003_01_000004 is : 143
2015-09-24 14:18:26,482 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1443118592213_0003_01_000005 is : 143
2015-09-24 14:18:26,662 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1443118592213_0002_01_000005 is : 143
2015-09-24 14:18:26,863 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1443118592213_0003_01_000003 is : 143
2015-09-24 14:18:26,872 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1443118592213_0002_01_000003 is : 143
2015-09-24 14:18:27,051 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1443118592213_0003_01_000002 is : 143
2015-09-24 14:18:27,115 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1443118592213_0002_01_000002 is : 143
2015-09-24 14:18:27,210 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(223)) - Exit code from container container_1443118592213_0002_01_000004 is : 143
2015-09-24 14:18:28,495 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/key/_temporary
2015-09-24 14:18:28,498 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [key] completed in: 01:01.742
2015-09-24 14:18:28,499 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] completed flow: key
2015-09-24 14:18:28,532 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/writablesequencefileplatform/testWritable/value/_temporary
2015-09-24 14:18:28,535 INFO flow.Flow (BaseFlow.java:logInfo(1433)) - [value] completed in: 01:01.782
2015-09-24 14:18:28,535 INFO cascade.Cascade (BaseCascade.java:logInfo(860)) - [keyvalues] completed flow: value
2015-09-24 14:18:28,681 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/writablesequencefileplatform/testWritable/key
2015-09-24 14:18:28,701 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/writablesequencefileplatform/testWritable/keyvalue
2015-09-24 14:18:28,721 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(189)) - copying to local /Users/ryan/concurrent_2015/compat_suite/new/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/writablesequencefileplatform/testWritable/value