Class cascading.tap.hadoop.HadoopTapPlatformTest

19

tests

0

failures

0

ignored

3m46.27s

duration

100%

successful

Tests

Test Duration Result
testChildIdentifiers 0.244s passed
testCombinedHfs 0.087s passed
testCombinedPartitionTap 28.261s passed
testCommitResource 21.371s passed
testCommitResourceFails 21.203s passed
testDfs 0.014s passed
testDupeConfigFromScheme 19.503s passed
testGlobHfs 16.394s passed
testHfsAsterisk 0.028s passed
testHfsBracketAsterisk 0.044s passed
testLfs 0.013s passed
testMissingInputFormat 0.047s passed
testMultiSourceIterator 0.203s passed
testNestedMultiSourceGlobHfs 44.253s passed
testNullsFromScheme 34.502s passed
testPrepareResource 21.849s passed
testPrepareResourceForReadFails 0.028s passed
testPrepareResourceForWriteFails 0.030s passed
testResolvedSinkFields 18.198s passed

Standard output

2015-05-20 16:04:19,465 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(187)) - found 1 test platforms from classpath
2015-05-20 16:04:19,495 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(237)) - installing platform: hadoop2-mr1
2015-05-20 16:04:19,496 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(238)) - running test: cascading.tap.hadoop.HadoopTapPlatformTest
2015-05-20 16:04:19,513 INFO  hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(121)) - using cluster
2015-05-20 16:04:20,096 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
2015-05-20 16:04:20,644 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2015-05-20 16:04:23,831 WARN  fair.AllocationFileLoaderService (AllocationFileLoaderService.java:getAllocationFile(179)) - fair-scheduler.xml not found on the classpath.
2015-05-20 16:04:24,099 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-05-20 16:04:24,305 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-05-20 16:04:24,523 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-05-20 16:04:24,702 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-05-20 16:04:41,856 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 16:04:41,856 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 16:04:41,862 INFO  property.AppProps (AppProps.java:getAppID(169)) - using app.id: A2CBA332C51E427FB54BFD8D93106280
2015-05-20 16:04:41,953 INFO  util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 2.7.0
2015-05-20 16:04:41,954 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test] starting
2015-05-20 16:04:41,955 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  source: Hfs["CommentScheme[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/comments+lower.txt"]
2015-05-20 16:04:41,955 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/testnulls"]
2015-05-20 16:04:41,956 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  parallel execution is enabled: true
2015-05-20 16:04:41,956 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  starting jobs: 1
2015-05-20 16:04:41,956 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  allocating threads: 1
2015-05-20 16:04:41,957 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [test] starting step: (1/1) ...dooptapplatform/testnulls
2015-05-20 16:04:42,664 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [test] submitted hadoop job: job_1432163076267_0001
2015-05-20 16:04:42,664 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [test] tracking url: http://Edinburgh.local:55687/proxy/application_1432163076267_0001/
2015-05-20 16:04:52,693 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0001_01_000002 is : 143
2015-05-20 16:04:53,936 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/testnulls/_temporary
2015-05-20 16:04:54,005 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/hadooptapplatform/testnulls
2015-05-20 16:04:54,049 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 16:04:54,050 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 16:04:54,060 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/hadooptapplatform/missinginputformat
2015-05-20 16:04:54,269 INFO  hadoop.Hfs (Hfs.java:makeLocal(507)) - forcing job to local mode, via source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt"]
2015-05-20 16:04:54,317 INFO  hadoop.Hfs (Hfs.java:makeLocal(507)) - forcing job to local mode, via source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt"]
2015-05-20 16:04:54,367 INFO  hadoop.Hfs (Hfs.java:makeLocal(507)) - forcing job to local mode, via source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt"]
2015-05-20 16:04:54,414 INFO  hadoop.Hfs (Hfs.java:makeLocal(507)) - forcing job to local mode, via source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt"]
2015-05-20 16:04:54,437 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 16:04:54,437 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 16:04:54,450 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test] starting
2015-05-20 16:04:54,451 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  source: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt"]
2015-05-20 16:04:54,451 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  sink: Hfs["ResolvedScheme[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/resolvedfields"]
2015-05-20 16:04:54,451 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  parallel execution is enabled: true
2015-05-20 16:04:54,451 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  starting jobs: 1
2015-05-20 16:04:54,452 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  allocating threads: 1
2015-05-20 16:04:54,452 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [test] starting step: (1/1) ...applatform/resolvedfields
2015-05-20 16:04:54,604 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [test] submitted hadoop job: job_1432163076267_0002
2015-05-20 16:04:54,605 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [test] tracking url: http://Edinburgh.local:55687/proxy/application_1432163076267_0002/
2015-05-20 16:05:04,086 WARN  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1432163076267_0002_01_000008
2015-05-20 16:05:10,592 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0002_01_000002 is : 143
2015-05-20 16:05:10,907 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0002_01_000006 is : 143
2015-05-20 16:05:11,095 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0002_01_000004 is : 143
2015-05-20 16:05:11,251 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0002_01_000003 is : 143
2015-05-20 16:05:11,349 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0002_01_000005 is : 143
2015-05-20 16:05:12,563 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/resolvedfields/_temporary
2015-05-20 16:05:12,604 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/hadooptapplatform/resolvedfields
2015-05-20 16:05:12,661 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 16:05:12,662 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 16:05:12,667 INFO  hadoop.Hfs (Hfs.java:makeLocal(507)) - forcing job to local mode, via source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt"]
2015-05-20 16:05:12,690 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 16:05:12,690 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 16:05:12,722 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first+second] starting
2015-05-20 16:05:12,724 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first+second]  parallel execution is enabled: true
2015-05-20 16:05:12,724 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first+second]  starting flows: 2
2015-05-20 16:05:12,724 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first+second]  allocating threads: 2
2015-05-20 16:05:12,725 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first+second] starting flow: first
2015-05-20 16:05:12,725 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first] at least one sink is marked for delete
2015-05-20 16:05:12,726 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first] sink oldest modified date: Wed Dec 31 15:59:59 PST 1969
2015-05-20 16:05:12,729 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first] starting
2015-05-20 16:05:12,729 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first]  source: GlobHfs[/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/?{ppe[_r],owe?}.txt]
2015-05-20 16:05:12,729 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/glob"]
2015-05-20 16:05:12,729 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first]  parallel execution is enabled: true
2015-05-20 16:05:12,729 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first]  starting jobs: 1
2015-05-20 16:05:12,729 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first]  allocating threads: 1
2015-05-20 16:05:12,730 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [first] starting step: (1/1) ...r1/hadooptapplatform/glob
2015-05-20 16:05:12,818 WARN  conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi179876067/.staging/job_local179876067_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-05-20 16:05:12,821 WARN  conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/staging/soberoi179876067/.staging/job_local179876067_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-05-20 16:05:12,957 WARN  conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local179876067_0001/job_local179876067_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-05-20 16:05:12,960 WARN  conf.Configuration (Configuration.java:loadProperty(2510)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/tmp/mapred/local/localRunner/soberoi/job_local179876067_0001/job_local179876067_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-05-20 16:05:12,963 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [first] submitted hadoop job: job_local179876067_0001
2015-05-20 16:05:12,963 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [first] tracking url: http://localhost:8080/
2015-05-20 16:05:12,999 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt
2015-05-20 16:05:13,008 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 16:05:13,008 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx512m
2015-05-20 16:05:13,033 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: GlobHfs[/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/?{ppe[_r],owe?}.txt]
2015-05-20 16:05:13,033 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/glob"]
2015-05-20 16:05:13,065 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt
2015-05-20 16:05:13,074 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 16:05:13,074 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx512m
2015-05-20 16:05:13,079 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: GlobHfs[/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/?{ppe[_r],owe?}.txt]
2015-05-20 16:05:13,080 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/glob"]
2015-05-20 16:05:13,143 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/glob/_temporary
2015-05-20 16:05:13,144 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first+second] completed flow: first
2015-05-20 16:05:13,145 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first+second] starting flow: second
2015-05-20 16:05:13,145 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second] at least one sink is marked for delete
2015-05-20 16:05:13,145 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second] sink oldest modified date: Wed Dec 31 15:59:59 PST 1969
2015-05-20 16:05:13,148 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second] starting
2015-05-20 16:05:13,148 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/glob"]
2015-05-20 16:05:13,148 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/glob2"]
2015-05-20 16:05:13,149 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second]  parallel execution is enabled: true
2015-05-20 16:05:13,149 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second]  starting jobs: 1
2015-05-20 16:05:13,149 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second]  allocating threads: 1
2015-05-20 16:05:13,150 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [second] starting step: (1/1) ...1/hadooptapplatform/glob2
2015-05-20 16:05:13,316 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [second] submitted hadoop job: job_1432163076267_0003
2015-05-20 16:05:13,316 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [second] tracking url: http://Edinburgh.local:55687/proxy/application_1432163076267_0003/
2015-05-20 16:05:27,259 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0003_01_000004 is : 143
2015-05-20 16:05:27,667 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0003_01_000005 is : 143
2015-05-20 16:05:27,731 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0003_01_000003 is : 143
2015-05-20 16:05:27,750 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0003_01_000002 is : 143
2015-05-20 16:05:28,968 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/glob2/_temporary
2015-05-20 16:05:28,969 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first+second] completed flow: second
2015-05-20 16:05:28,989 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/hadooptapplatform/glob2
2015-05-20 16:05:29,005 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/hadooptapplatform/glob
2015-05-20 16:05:29,033 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 16:05:29,033 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 16:05:29,058 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test] starting
2015-05-20 16:05:29,059 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  source: ["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/apache.10.txt"]
2015-05-20 16:05:29,059 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  sink: ["TextDelimited[['ip', 'count']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/preparetap"]
2015-05-20 16:05:29,059 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  parallel execution is enabled: true
2015-05-20 16:05:29,059 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  starting jobs: 1
2015-05-20 16:05:29,059 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  allocating threads: 1
2015-05-20 16:05:29,060 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [test] starting step: (1/1) ...ooptapplatform/preparetap
2015-05-20 16:05:29,182 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [test] submitted hadoop job: job_1432163076267_0004
2015-05-20 16:05:29,182 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [test] tracking url: http://Edinburgh.local:55687/proxy/application_1432163076267_0004/
2015-05-20 16:05:43,736 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0004_01_000002 is : 143
2015-05-20 16:05:43,816 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0004_01_000003 is : 143
2015-05-20 16:05:43,909 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0004_01_000005 is : 143
2015-05-20 16:05:44,012 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0004_01_000004 is : 143
2015-05-20 16:05:49,646 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0004_01_000006 is : 143
2015-05-20 16:05:50,842 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/preparetap/_temporary
2015-05-20 16:05:50,859 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/hadooptapplatform/preparetap
2015-05-20 16:05:50,880 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 16:05:50,880 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 16:05:50,900 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [lower*upper] starting
2015-05-20 16:05:50,901 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [lower*upper]  source: Hfs["DupeConfigScheme[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt"]
2015-05-20 16:05:50,901 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt"]
2015-05-20 16:05:50,901 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [lower*upper]  sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/dupeconfig"]
2015-05-20 16:05:50,901 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [lower*upper]  parallel execution is enabled: true
2015-05-20 16:05:50,902 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [lower*upper]  starting jobs: 1
2015-05-20 16:05:50,902 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [lower*upper]  allocating threads: 1
2015-05-20 16:05:50,903 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [lower*upper] starting step: (1/1) ...ooptapplatform/dupeconfig
2015-05-20 16:05:51,044 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [lower*upper] submitted hadoop job: job_1432163076267_0005
2015-05-20 16:05:51,044 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [lower*upper] tracking url: http://Edinburgh.local:55687/proxy/application_1432163076267_0005/
2015-05-20 16:06:08,430 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0005_01_000002 is : 143
2015-05-20 16:06:08,982 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0005_01_000005 is : 143
2015-05-20 16:06:09,021 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0005_01_000006 is : 143
2015-05-20 16:06:09,031 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0005_01_000003 is : 143
2015-05-20 16:06:09,080 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0005_01_000004 is : 143
2015-05-20 16:06:10,290 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/dupeconfig/_temporary
2015-05-20 16:06:10,351 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/hadooptapplatform/dupeconfig
2015-05-20 16:06:10,382 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 16:06:10,382 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 16:06:10,403 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 16:06:10,404 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 16:06:10,465 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first+second] starting
2015-05-20 16:06:10,466 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first+second]  parallel execution is enabled: true
2015-05-20 16:06:10,466 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first+second]  starting flows: 2
2015-05-20 16:06:10,466 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first+second]  allocating threads: 2
2015-05-20 16:06:10,467 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first+second] starting flow: first
2015-05-20 16:06:10,467 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first] at least one sink is marked for delete
2015-05-20 16:06:10,468 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first] sink oldest modified date: Wed Dec 31 15:59:59 PST 1969
2015-05-20 16:06:10,471 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first] starting
2015-05-20 16:06:10,471 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first]  source: MultiSourceTap[2:[GlobHfs[/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/?{ppe[_r]}.txt], GlobHfs[/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/?{owe?}.txt]]]
2015-05-20 16:06:10,471 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/globmultisource"]
2015-05-20 16:06:10,471 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first]  parallel execution is enabled: true
2015-05-20 16:06:10,471 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first]  starting jobs: 1
2015-05-20 16:06:10,471 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first]  allocating threads: 1
2015-05-20 16:06:10,473 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [first] starting step: (1/1) ...pplatform/globmultisource
2015-05-20 16:06:10,585 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [first] submitted hadoop job: job_1432163076267_0006
2015-05-20 16:06:10,585 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [first] tracking url: http://Edinburgh.local:55687/proxy/application_1432163076267_0006/
2015-05-20 16:06:20,038 WARN  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1432163076267_0006_01_000009
2015-05-20 16:06:20,099 WARN  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1432163076267_0006_01_000010
2015-05-20 16:06:28,757 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0006_01_000002 is : 143
2015-05-20 16:06:29,290 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0006_01_000003 is : 143
2015-05-20 16:06:29,364 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0006_01_000005 is : 143
2015-05-20 16:06:29,365 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0006_01_000004 is : 143
2015-05-20 16:06:29,419 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0006_01_000007 is : 143
2015-05-20 16:06:29,476 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0006_01_000006 is : 143
2015-05-20 16:06:30,680 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/globmultisource/_temporary
2015-05-20 16:06:30,681 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first+second] completed flow: first
2015-05-20 16:06:30,681 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first+second] starting flow: second
2015-05-20 16:06:30,682 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second] at least one sink is marked for delete
2015-05-20 16:06:30,682 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second] sink oldest modified date: Wed Dec 31 15:59:59 PST 1969
2015-05-20 16:06:30,685 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second] starting
2015-05-20 16:06:30,685 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/globmultisource"]
2015-05-20 16:06:30,685 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/globmultiource2"]
2015-05-20 16:06:30,685 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second]  parallel execution is enabled: true
2015-05-20 16:06:30,685 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second]  starting jobs: 1
2015-05-20 16:06:30,685 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second]  allocating threads: 1
2015-05-20 16:06:30,686 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [second] starting step: (1/1) ...pplatform/globmultiource2
2015-05-20 16:06:30,759 WARN  blockmanagement.BlockPlacementPolicy (BlockPlacementPolicyDefault.java:chooseTarget(313)) - Failed to place enough replicas, still in need of 1 to reach 4. For more information, please enable DEBUG log level on org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicy
2015-05-20 16:06:30,845 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [second] submitted hadoop job: job_1432163076267_0007
2015-05-20 16:06:30,845 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [second] tracking url: http://Edinburgh.local:55687/proxy/application_1432163076267_0007/
2015-05-20 16:06:40,366 WARN  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1432163076267_0007_01_000011
2015-05-20 16:06:40,439 WARN  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1432163076267_0007_01_000012
2015-05-20 16:06:40,503 WARN  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1432163076267_0007_01_000013
2015-05-20 16:06:52,371 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0007_01_000002 is : 143
2015-05-20 16:06:52,805 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0007_01_000006 is : 143
2015-05-20 16:06:52,964 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0007_01_000003 is : 143
2015-05-20 16:06:53,100 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0007_01_000005 is : 143
2015-05-20 16:06:53,135 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0007_01_000009 is : 143
2015-05-20 16:06:53,172 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0007_01_000008 is : 143
2015-05-20 16:06:53,194 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0007_01_000007 is : 143
2015-05-20 16:06:53,298 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0007_01_000004 is : 143
2015-05-20 16:06:54,564 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/globmultiource2/_temporary
2015-05-20 16:06:54,565 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first+second] completed flow: second
2015-05-20 16:06:54,591 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/hadooptapplatform/globmultiource2
2015-05-20 16:06:54,607 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/hadooptapplatform/globmultisource
2015-05-20 16:06:54,662 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 16:06:54,662 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 16:06:54,673 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test] starting
2015-05-20 16:06:54,673 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/apache.10.txt"]
2015-05-20 16:06:54,674 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  sink: ["TextDelimited[['ip', 'count']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/preparewritetapfail"]
2015-05-20 16:06:54,674 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  parallel execution is enabled: true
2015-05-20 16:06:54,674 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  starting jobs: 1
2015-05-20 16:06:54,674 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  allocating threads: 1
2015-05-20 16:06:54,675 ERROR flow.FlowStep (BaseFlowStep.java:logError(910)) - [test] unable to prepare tap for write: hdfs://localhost:55659/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/preparewritetapfail
java.io.IOException: failed intentionally
	at cascading.tap.hadoop.HadoopTapPlatformTest$7.prepareResourceForWrite(HadoopTapPlatformTest.java:849)
	at cascading.tap.hadoop.HadoopTapPlatformTest$7.prepareResourceForWrite(HadoopTapPlatformTest.java:845)
	at cascading.flow.planner.BaseFlowStep.prepareResource(BaseFlowStep.java:456)
	at cascading.flow.planner.BaseFlowStep.prepareResources(BaseFlowStep.java:438)
	at cascading.flow.planner.BaseFlowStep.prepareResources(BaseFlowStep.java:424)
	at cascading.flow.planner.FlowStepJob.prepareResources(FlowStepJob.java:188)
	at cascading.flow.planner.FlowStepJob.start(FlowStepJob.java:158)
	at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:124)
	at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:43)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2015-05-20 16:06:54,678 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test] stopping all jobs
2015-05-20 16:06:54,680 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [test] stopping: (1/1) ...tform/preparewritetapfail
2015-05-20 16:06:54,680 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test] stopped all jobs
2015-05-20 16:06:54,681 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/hadooptapplatform/preparewritetapfail
2015-05-20 16:06:54,693 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 16:06:54,693 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 16:06:54,705 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test] starting
2015-05-20 16:06:54,705 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  source: ["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/apache.10.txt"]
2015-05-20 16:06:54,706 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  sink: Hfs["TextDelimited[['ip', 'count']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/preparereadtapfail"]
2015-05-20 16:06:54,706 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  parallel execution is enabled: true
2015-05-20 16:06:54,706 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  starting jobs: 1
2015-05-20 16:06:54,706 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  allocating threads: 1
2015-05-20 16:06:54,707 ERROR flow.FlowStep (BaseFlowStep.java:logError(910)) - [test] unable to prepare tap for read: hdfs://localhost:55659/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/apache.10.txt
java.io.IOException: failed intentionally
	at cascading.tap.hadoop.HadoopTapPlatformTest$6.prepareResourceForRead(HadoopTapPlatformTest.java:801)
	at cascading.tap.hadoop.HadoopTapPlatformTest$6.prepareResourceForRead(HadoopTapPlatformTest.java:797)
	at cascading.flow.planner.BaseFlowStep.prepareResource(BaseFlowStep.java:458)
	at cascading.flow.planner.BaseFlowStep.prepareResources(BaseFlowStep.java:438)
	at cascading.flow.planner.BaseFlowStep.prepareResources(BaseFlowStep.java:421)
	at cascading.flow.planner.FlowStepJob.prepareResources(FlowStepJob.java:188)
	at cascading.flow.planner.FlowStepJob.start(FlowStepJob.java:158)
	at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:124)
	at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:43)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2015-05-20 16:06:54,707 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test] stopping all jobs
2015-05-20 16:06:54,708 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [test] stopping: (1/1) ...atform/preparereadtapfail
2015-05-20 16:06:54,708 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test] stopped all jobs
2015-05-20 16:06:54,709 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/hadooptapplatform/preparereadtapfail
2015-05-20 16:06:54,725 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 16:06:54,725 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 16:06:54,738 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test] starting
2015-05-20 16:06:54,738 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/apache.10.txt"]
2015-05-20 16:06:54,738 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  sink: ["TextDelimited[['ip', 'count']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/committapfail"]
2015-05-20 16:06:54,738 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  parallel execution is enabled: true
2015-05-20 16:06:54,738 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  starting jobs: 1
2015-05-20 16:06:54,739 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  allocating threads: 1
2015-05-20 16:06:54,739 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [test] starting step: (1/1) ...tapplatform/committapfail
2015-05-20 16:06:54,860 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [test] submitted hadoop job: job_1432163076267_0008
2015-05-20 16:06:54,860 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [test] tracking url: http://Edinburgh.local:55687/proxy/application_1432163076267_0008/
2015-05-20 16:07:08,981 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0008_01_000002 is : 143
2015-05-20 16:07:09,295 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0008_01_000005 is : 143
2015-05-20 16:07:09,337 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0008_01_000003 is : 143
2015-05-20 16:07:09,374 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0008_01_000004 is : 143
2015-05-20 16:07:14,708 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0008_01_000006 is : 143
2015-05-20 16:07:15,870 ERROR flow.FlowStep (BaseFlowStep.java:logError(910)) - [test] unable to commit sink: hdfs://localhost:55659/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/committapfail
java.io.IOException: failed intentionally
	at cascading.tap.hadoop.HadoopTapPlatformTest$2.commitResource(HadoopTapPlatformTest.java:406)
	at cascading.tap.hadoop.HadoopTapPlatformTest$2.commitResource(HadoopTapPlatformTest.java:402)
	at cascading.flow.planner.BaseFlowStep.commitResource(BaseFlowStep.java:502)
	at cascading.flow.planner.BaseFlowStep.commitSinks(BaseFlowStep.java:490)
	at cascading.flow.planner.FlowStepJob.blockOnJob(FlowStepJob.java:267)
	at cascading.flow.planner.FlowStepJob.start(FlowStepJob.java:162)
	at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:124)
	at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:43)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2015-05-20 16:07:15,899 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test] stopping all jobs
2015-05-20 16:07:15,900 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [test] stopping: (1/1) ...tapplatform/committapfail
2015-05-20 16:07:15,901 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test] stopped all jobs
2015-05-20 16:07:15,903 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/committapfail/_temporary
2015-05-20 16:07:15,907 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/hadooptapplatform/committapfail
2015-05-20 16:07:15,927 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 16:07:15,927 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 16:07:15,939 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test] starting
2015-05-20 16:07:15,939 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/apache.10.txt"]
2015-05-20 16:07:15,940 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  sink: ["TextDelimited[['ip', 'count']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/committap"]
2015-05-20 16:07:15,940 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  parallel execution is enabled: true
2015-05-20 16:07:15,940 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  starting jobs: 1
2015-05-20 16:07:15,940 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  allocating threads: 1
2015-05-20 16:07:15,941 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [test] starting step: (1/1) ...dooptapplatform/committap
2015-05-20 16:07:16,054 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [test] submitted hadoop job: job_1432163076267_0009
2015-05-20 16:07:16,055 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [test] tracking url: http://Edinburgh.local:55687/proxy/application_1432163076267_0009/
2015-05-20 16:07:30,036 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0009_01_000002 is : 143
2015-05-20 16:07:30,391 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0009_01_000003 is : 143
2015-05-20 16:07:30,481 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0009_01_000005 is : 143
2015-05-20 16:07:30,485 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0009_01_000004 is : 143
2015-05-20 16:07:36,095 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0009_01_000006 is : 143
2015-05-20 16:07:37,265 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/committap/_temporary
2015-05-20 16:07:37,280 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/hadooptapplatform/committap
2015-05-20 16:07:37,306 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:setupTask(98)) - setting up task: 'attempt_002147483647_0000_m_000000_0' - hdfs://localhost:55659/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/multifiles/A/_temporary/_attempt_002147483647_0000_m_000000_0
2015-05-20 16:07:37,306 INFO  io.TapOutputCollector (TapOutputCollector.java:initialize(112)) - creating path: part-00000
2015-05-20 16:07:37,308 INFO  io.TapOutputCollector (TapOutputCollector.java:close(145)) - closing tap collector for: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/multifiles/A/part-00000
2015-05-20 16:07:37,322 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(155)) - committing task: 'attempt_002147483647_0000_m_000000_0' - hdfs://localhost:55659/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/multifiles/A/_temporary/_attempt_002147483647_0000_m_000000_0
2015-05-20 16:07:37,328 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(172)) - saved output of task 'attempt_002147483647_0000_m_000000_0' to hdfs://localhost:55659/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/multifiles/A
2015-05-20 16:07:37,329 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path hdfs://localhost:55659/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/multifiles/A/_temporary
2015-05-20 16:07:37,334 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:setupTask(98)) - setting up task: 'attempt_002147483647_0000_m_000000_0' - hdfs://localhost:55659/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/multifiles/B/_temporary/_attempt_002147483647_0000_m_000000_0
2015-05-20 16:07:37,335 INFO  io.TapOutputCollector (TapOutputCollector.java:initialize(112)) - creating path: part-00000
2015-05-20 16:07:37,337 INFO  io.TapOutputCollector (TapOutputCollector.java:close(145)) - closing tap collector for: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/multifiles/B/part-00000
2015-05-20 16:07:37,348 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(155)) - committing task: 'attempt_002147483647_0000_m_000000_0' - hdfs://localhost:55659/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/multifiles/B/_temporary/_attempt_002147483647_0000_m_000000_0
2015-05-20 16:07:37,353 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(172)) - saved output of task 'attempt_002147483647_0000_m_000000_0' to hdfs://localhost:55659/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/multifiles/B
2015-05-20 16:07:37,353 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path hdfs://localhost:55659/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/multifiles/B/_temporary
2015-05-20 16:07:37,396 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:setupTask(98)) - setting up task: 'attempt_002147483647_0000_m_000000_0' - hdfs://localhost:55659/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/hiddenfiles/A/_temporary/_attempt_002147483647_0000_m_000000_0
2015-05-20 16:07:37,397 INFO  io.TapOutputCollector (TapOutputCollector.java:initialize(112)) - creating path: part-00000
2015-05-20 16:07:37,399 INFO  io.TapOutputCollector (TapOutputCollector.java:close(145)) - closing tap collector for: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/hiddenfiles/A/part-00000
2015-05-20 16:07:37,410 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(155)) - committing task: 'attempt_002147483647_0000_m_000000_0' - hdfs://localhost:55659/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/hiddenfiles/A/_temporary/_attempt_002147483647_0000_m_000000_0
2015-05-20 16:07:37,417 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(172)) - saved output of task 'attempt_002147483647_0000_m_000000_0' to hdfs://localhost:55659/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/hiddenfiles/A
2015-05-20 16:07:37,419 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path hdfs://localhost:55659/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/hiddenfiles/A/_temporary
2015-05-20 16:07:37,426 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:setupTask(98)) - setting up task: 'attempt_002147483647_0000_m_000000_0' - hdfs://localhost:55659/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/hiddenfiles/B/_temporary/_attempt_002147483647_0000_m_000000_0
2015-05-20 16:07:37,426 INFO  io.TapOutputCollector (TapOutputCollector.java:initialize(112)) - creating path: part-00000
2015-05-20 16:07:37,428 INFO  io.TapOutputCollector (TapOutputCollector.java:close(145)) - closing tap collector for: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/hiddenfiles/B/part-00000
2015-05-20 16:07:37,442 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(155)) - committing task: 'attempt_002147483647_0000_m_000000_0' - hdfs://localhost:55659/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/hiddenfiles/B/_temporary/_attempt_002147483647_0000_m_000000_0
2015-05-20 16:07:37,447 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(172)) - saved output of task 'attempt_002147483647_0000_m_000000_0' to hdfs://localhost:55659/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/hiddenfiles/B
2015-05-20 16:07:37,448 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path hdfs://localhost:55659/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/hiddenfiles/B/_temporary
2015-05-20 16:07:37,452 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:setupTask(98)) - setting up task: 'attempt_002147483647_0000_m_000000_0' - hdfs://localhost:55659/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/hiddenfiles/.hidden/_temporary/_attempt_002147483647_0000_m_000000_0
2015-05-20 16:07:37,452 INFO  io.TapOutputCollector (TapOutputCollector.java:initialize(112)) - creating path: part-00000
2015-05-20 16:07:37,454 INFO  io.TapOutputCollector (TapOutputCollector.java:close(145)) - closing tap collector for: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/hiddenfiles/.hidden/part-00000
2015-05-20 16:07:37,466 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(155)) - committing task: 'attempt_002147483647_0000_m_000000_0' - hdfs://localhost:55659/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/hiddenfiles/.hidden/_temporary/_attempt_002147483647_0000_m_000000_0
2015-05-20 16:07:37,474 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(172)) - saved output of task 'attempt_002147483647_0000_m_000000_0' to hdfs://localhost:55659/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/hiddenfiles/.hidden
2015-05-20 16:07:37,475 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path hdfs://localhost:55659/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/hiddenfiles/.hidden/_temporary
2015-05-20 16:07:37,489 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/hadooptapplatform/multifiles/B
2015-05-20 16:07:37,493 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/hadooptapplatform/hiddenfiles
2015-05-20 16:07:37,505 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/hadooptapplatform/multifiles/A
2015-05-20 16:07:37,510 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/hadooptapplatform/multifiles
2015-05-20 16:07:37,513 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/hadooptapplatform/hiddenfiles/.hidden
2015-05-20 16:07:37,519 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/hadooptapplatform/hiddenfiles/A
2015-05-20 16:07:37,525 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/hadooptapplatform/hiddenfiles/B
2015-05-20 16:07:37,558 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 16:07:37,559 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 16:07:37,574 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [partition] starting
2015-05-20 16:07:37,574 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [partition]  source: Hfs["TextDelimited[['number', 'lower']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt"]
2015-05-20 16:07:37,574 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [partition]  sink: PartitionTap["Hfs["TextDelimited[['lower']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/combinedpartition/partitioned"]"]["cascading.tap.partition.DelimitedPartition@585f1a6b"]
2015-05-20 16:07:37,574 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [partition]  parallel execution is enabled: true
2015-05-20 16:07:37,574 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [partition]  starting jobs: 1
2015-05-20 16:07:37,574 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [partition]  allocating threads: 1
2015-05-20 16:07:37,575 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [partition] starting step: (1/1) ...inedpartition/partitioned
2015-05-20 16:07:37,680 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [partition] submitted hadoop job: job_1432163076267_0010
2015-05-20 16:07:37,681 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [partition] tracking url: http://Edinburgh.local:55687/proxy/application_1432163076267_0010/
2015-05-20 16:07:53,881 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0010_01_000003 is : 143
2015-05-20 16:07:54,057 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0010_01_000002 is : 143
2015-05-20 16:07:54,090 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0010_01_000006 is : 143
2015-05-20 16:07:54,330 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0010_01_000004 is : 143
2015-05-20 16:07:54,380 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0010_01_000005 is : 143
2015-05-20 16:07:55,565 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/combinedpartition/partitioned/_temporary
2015-05-20 16:07:55,578 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 16:07:55,579 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 16:07:55,591 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [copy] starting
2015-05-20 16:07:55,591 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [copy]  source: PartitionTap["Hfs["TextDelimited[['lower']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/combinedpartition/partitioned"]"]["cascading.tap.partition.DelimitedPartition@585f1a6b"]
2015-05-20 16:07:55,591 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [copy]  sink: Hfs["TextDelimited[['number', 'lower']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/combinedpartition/final"]
2015-05-20 16:07:55,591 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [copy]  parallel execution is enabled: true
2015-05-20 16:07:55,591 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [copy]  starting jobs: 1
2015-05-20 16:07:55,591 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [copy]  allocating threads: 1
2015-05-20 16:07:55,592 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [copy] starting step: (1/1) ...m/combinedpartition/final
2015-05-20 16:07:55,713 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [copy] submitted hadoop job: job_1432163076267_0011
2015-05-20 16:07:55,713 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [copy] tracking url: http://Edinburgh.local:55687/proxy/application_1432163076267_0011/
2015-05-20 16:08:04,569 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1432163076267_0011_01_000002 is : 143
2015-05-20 16:08:05,750 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/hadooptapplatform/combinedpartition/final/_temporary
2015-05-20 16:08:05,766 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/hadooptapplatform/combinedpartition/partitioned
2015-05-20 16:08:05,786 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/hadooptapplatform/combinedpartition/final

Standard error

May 20, 2015 4:04:36 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class
May 20, 2015 4:04:36 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class
May 20, 2015 4:04:36 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 20, 2015 4:04:36 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 20, 2015 4:04:36 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 20, 2015 4:04:36 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 20, 2015 4:04:37 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest"
May 20, 2015 4:04:37 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 20, 2015 4:04:37 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class
May 20, 2015 4:04:37 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class
May 20, 2015 4:04:37 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 20, 2015 4:04:37 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 20, 2015 4:04:37 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 20, 2015 4:04:38 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 20, 2015 4:04:38 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 20, 2015 4:04:38 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 20, 2015 4:04:38 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
May 20, 2015 4:04:38 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 20, 2015 4:04:38 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
May 20, 2015 4:04:38 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 20, 2015 4:04:38 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 20, 2015 4:04:38 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 20, 2015 4:04:39 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 20, 2015 4:04:39 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 20, 2015 4:04:39 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
May 20, 2015 4:04:39 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 20, 2015 4:04:39 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
May 20, 2015 4:04:39 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 20, 2015 4:04:39 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 20, 2015 4:04:39 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 20, 2015 4:04:39 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 20, 2015 4:04:40 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 20, 2015 4:04:40 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
May 20, 2015 4:04:40 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 20, 2015 4:04:40 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
May 20, 2015 4:04:40 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 20, 2015 4:04:40 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 20, 2015 4:04:40 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 20, 2015 4:04:41 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 20, 2015 4:04:41 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.