Class cascading.tap.hadoop.HadoopTapPlatformTest

19

tests

0

failures

0

ignored

3m18.34s

duration

100%

successful

Tests

Test Duration Result
testChildIdentifiers 0.205s passed
testCombinedHfs 0.088s passed
testCombinedPartitionTap 27.001s passed
testCommitResource 19.613s passed
testCommitResourceFails 19.405s passed
testDfs 0.013s passed
testDupeConfigFromScheme 16.930s passed
testGlobHfs 15.299s passed
testHfsAsterisk 0.042s passed
testHfsBracketAsterisk 0.054s passed
testLfs 0.011s passed
testMissingInputFormat 0.049s passed
testMultiSourceIterator 0.167s passed
testNestedMultiSourceGlobHfs 40.783s passed
testNullsFromScheme 21.601s passed
testPrepareResource 19.912s passed
testPrepareResourceForReadFails 0.024s passed
testPrepareResourceForWriteFails 0.032s passed
testResolvedSinkFields 17.109s passed

Standard output

2015-05-20 20:26:57,497 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(187)) - found 1 test platforms from classpath
2015-05-20 20:26:57,524 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(237)) - installing platform: hadoop2-mr1
2015-05-20 20:26:57,524 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(238)) - running test: cascading.tap.hadoop.HadoopTapPlatformTest
2015-05-20 20:26:57,541 INFO  hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(121)) - using cluster
2015-05-20 20:26:58,103 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
2015-05-20 20:26:58,560 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2015-05-20 20:27:02,573 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-05-20 20:27:03,729 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-05-20 20:27:04,867 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-05-20 20:27:05,997 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-05-20 20:27:08,604 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:27:08,605 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:27:08,611 INFO  property.AppProps (AppProps.java:getAppID(169)) - using app.id: C1968198B85143BFB4344E6A69C180B6
2015-05-20 20:27:08,699 INFO  util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 2.7.0
2015-05-20 20:27:08,700 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test] starting
2015-05-20 20:27:08,700 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  source: Hfs["CommentScheme[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/comments+lower.txt"]
2015-05-20 20:27:08,701 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/testnulls"]
2015-05-20 20:27:08,701 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  parallel execution is enabled: true
2015-05-20 20:27:08,701 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  starting jobs: 1
2015-05-20 20:27:08,701 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  allocating threads: 1
2015-05-20 20:27:08,702 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [test] starting step: (1/1) ...dooptapplatform/testnulls
2015-05-20 20:27:09,162 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [test] submitted hadoop job: job_1432178820719_0001
2015-05-20 20:27:09,163 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [test] tracking url: http://Edinburgh.local:56621/proxy/application_1432178820719_0001/
2015-05-20 20:27:17,794 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0001_01_000002 is : 143
2015-05-20 20:27:19,049 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/testnulls/_temporary
2015-05-20 20:27:19,134 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/hadooptapplatform/testnulls
2015-05-20 20:27:19,183 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:27:19,183 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:27:19,191 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/hadooptapplatform/missinginputformat
2015-05-20 20:27:19,409 INFO  hadoop.Hfs (Hfs.java:makeLocal(507)) - forcing job to local mode, via source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-05-20 20:27:19,449 INFO  hadoop.Hfs (Hfs.java:makeLocal(507)) - forcing job to local mode, via source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-05-20 20:27:19,493 INFO  hadoop.Hfs (Hfs.java:makeLocal(507)) - forcing job to local mode, via source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-05-20 20:27:19,519 INFO  hadoop.Hfs (Hfs.java:makeLocal(507)) - forcing job to local mode, via source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-05-20 20:27:19,542 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:27:19,542 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:27:19,559 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test] starting
2015-05-20 20:27:19,560 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  source: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-05-20 20:27:19,560 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  sink: Hfs["ResolvedScheme[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/resolvedfields"]
2015-05-20 20:27:19,560 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  parallel execution is enabled: true
2015-05-20 20:27:19,561 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  starting jobs: 1
2015-05-20 20:27:19,561 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  allocating threads: 1
2015-05-20 20:27:19,561 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [test] starting step: (1/1) ...applatform/resolvedfields
2015-05-20 20:27:19,706 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [test] submitted hadoop job: job_1432178820719_0002
2015-05-20 20:27:19,707 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [test] tracking url: http://Edinburgh.local:56621/proxy/application_1432178820719_0002/
2015-05-20 20:27:35,016 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0002_01_000006 is : 143
2015-05-20 20:27:35,104 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0002_01_000004 is : 143
2015-05-20 20:27:35,184 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0002_01_000003 is : 143
2015-05-20 20:27:35,332 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0002_01_000005 is : 143
2015-05-20 20:27:35,362 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0002_01_000002 is : 143
2015-05-20 20:27:36,587 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/resolvedfields/_temporary
2015-05-20 20:27:36,623 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/hadooptapplatform/resolvedfields
2015-05-20 20:27:36,669 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:27:36,669 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:27:36,675 INFO  hadoop.Hfs (Hfs.java:makeLocal(507)) - forcing job to local mode, via source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-05-20 20:27:36,692 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:27:36,692 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:27:36,721 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first+second] starting
2015-05-20 20:27:36,723 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first+second]  parallel execution is enabled: true
2015-05-20 20:27:36,723 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first+second]  starting flows: 2
2015-05-20 20:27:36,723 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first+second]  allocating threads: 2
2015-05-20 20:27:36,723 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first+second] starting flow: first
2015-05-20 20:27:36,724 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first] at least one sink is marked for delete
2015-05-20 20:27:36,724 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first] sink oldest modified date: Wed Dec 31 15:59:59 PST 1969
2015-05-20 20:27:36,727 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first] starting
2015-05-20 20:27:36,727 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first]  source: GlobHfs[/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/?{ppe[_r],owe?}.txt]
2015-05-20 20:27:36,727 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/glob"]
2015-05-20 20:27:36,727 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first]  parallel execution is enabled: true
2015-05-20 20:27:36,727 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first]  starting jobs: 1
2015-05-20 20:27:36,727 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first]  allocating threads: 1
2015-05-20 20:27:36,728 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [first] starting step: (1/1) ...r1/hadooptapplatform/glob
2015-05-20 20:27:36,822 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi1479813002/.staging/job_local1479813002_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-05-20 20:27:36,829 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/staging/soberoi1479813002/.staging/job_local1479813002_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-05-20 20:27:36,944 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local1479813002_0001/job_local1479813002_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-05-20 20:27:36,944 WARN  conf.Configuration (Configuration.java:loadProperty(2172)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/tmp/mapred/local/localRunner/soberoi/job_local1479813002_0001/job_local1479813002_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-05-20 20:27:36,951 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [first] submitted hadoop job: job_local1479813002_0001
2015-05-20 20:27:36,951 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [first] tracking url: http://localhost:8080/
2015-05-20 20:27:36,983 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt
2015-05-20 20:27:36,991 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:27:36,991 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx512m
2015-05-20 20:27:37,014 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: GlobHfs[/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/?{ppe[_r],owe?}.txt]
2015-05-20 20:27:37,014 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/glob"]
2015-05-20 20:27:37,042 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt
2015-05-20 20:27:37,045 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.7.0
2015-05-20 20:27:37,046 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx512m
2015-05-20 20:27:37,051 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: GlobHfs[/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/?{ppe[_r],owe?}.txt]
2015-05-20 20:27:37,051 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/glob"]
2015-05-20 20:27:37,108 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/glob/_temporary
2015-05-20 20:27:37,109 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first+second] completed flow: first
2015-05-20 20:27:37,109 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first+second] starting flow: second
2015-05-20 20:27:37,111 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second] at least one sink is marked for delete
2015-05-20 20:27:37,112 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second] sink oldest modified date: Wed Dec 31 15:59:59 PST 1969
2015-05-20 20:27:37,114 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second] starting
2015-05-20 20:27:37,115 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/glob"]
2015-05-20 20:27:37,115 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/glob2"]
2015-05-20 20:27:37,115 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second]  parallel execution is enabled: true
2015-05-20 20:27:37,115 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second]  starting jobs: 1
2015-05-20 20:27:37,115 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second]  allocating threads: 1
2015-05-20 20:27:37,116 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [second] starting step: (1/1) ...1/hadooptapplatform/glob2
2015-05-20 20:27:37,269 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [second] submitted hadoop job: job_1432178820719_0003
2015-05-20 20:27:37,270 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [second] tracking url: http://Edinburgh.local:56621/proxy/application_1432178820719_0003/
2015-05-20 20:27:50,464 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0003_01_000004 is : 143
2015-05-20 20:27:50,564 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0003_01_000002 is : 143
2015-05-20 20:27:50,628 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0003_01_000005 is : 143
2015-05-20 20:27:50,699 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0003_01_000003 is : 143
2015-05-20 20:27:51,897 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/glob2/_temporary
2015-05-20 20:27:51,898 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first+second] completed flow: second
2015-05-20 20:27:51,915 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/hadooptapplatform/glob
2015-05-20 20:27:51,924 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/hadooptapplatform/glob2
2015-05-20 20:27:51,949 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:27:51,950 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:27:51,976 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test] starting
2015-05-20 20:27:51,976 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  source: ["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt"]
2015-05-20 20:27:51,977 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  sink: ["TextDelimited[['ip', 'count']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/preparetap"]
2015-05-20 20:27:51,977 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  parallel execution is enabled: true
2015-05-20 20:27:51,977 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  starting jobs: 1
2015-05-20 20:27:51,977 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  allocating threads: 1
2015-05-20 20:27:51,978 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [test] starting step: (1/1) ...ooptapplatform/preparetap
2015-05-20 20:27:52,094 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [test] submitted hadoop job: job_1432178820719_0004
2015-05-20 20:27:52,095 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [test] tracking url: http://Edinburgh.local:56621/proxy/application_1432178820719_0004/
2015-05-20 20:28:05,332 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0004_01_000003 is : 143
2015-05-20 20:28:05,366 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0004_01_000002 is : 143
2015-05-20 20:28:05,394 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0004_01_000004 is : 143
2015-05-20 20:28:05,424 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0004_01_000005 is : 143
2015-05-20 20:28:10,658 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0004_01_000006 is : 143
2015-05-20 20:28:11,829 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/preparetap/_temporary
2015-05-20 20:28:11,847 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/hadooptapplatform/preparetap
2015-05-20 20:28:11,866 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:28:11,866 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:28:11,883 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [lower*upper] starting
2015-05-20 20:28:11,883 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [lower*upper]  source: Hfs["DupeConfigScheme[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-05-20 20:28:11,883 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-05-20 20:28:11,883 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [lower*upper]  sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/dupeconfig"]
2015-05-20 20:28:11,883 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [lower*upper]  parallel execution is enabled: true
2015-05-20 20:28:11,883 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [lower*upper]  starting jobs: 1
2015-05-20 20:28:11,884 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [lower*upper]  allocating threads: 1
2015-05-20 20:28:11,884 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [lower*upper] starting step: (1/1) ...ooptapplatform/dupeconfig
2015-05-20 20:28:12,029 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [lower*upper] submitted hadoop job: job_1432178820719_0005
2015-05-20 20:28:12,029 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [lower*upper] tracking url: http://Edinburgh.local:56621/proxy/application_1432178820719_0005/
2015-05-20 20:28:26,952 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0005_01_000006 is : 143
2015-05-20 20:28:27,294 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0005_01_000003 is : 143
2015-05-20 20:28:27,325 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0005_01_000004 is : 143
2015-05-20 20:28:27,452 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0005_01_000002 is : 143
2015-05-20 20:28:27,528 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0005_01_000005 is : 143
2015-05-20 20:28:28,727 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/dupeconfig/_temporary
2015-05-20 20:28:28,769 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/hadooptapplatform/dupeconfig
2015-05-20 20:28:28,795 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:28:28,796 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:28:28,837 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:28:28,838 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:28:28,872 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first+second] starting
2015-05-20 20:28:28,873 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first+second]  parallel execution is enabled: true
2015-05-20 20:28:28,873 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first+second]  starting flows: 2
2015-05-20 20:28:28,873 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first+second]  allocating threads: 2
2015-05-20 20:28:28,874 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first+second] starting flow: first
2015-05-20 20:28:28,874 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first] at least one sink is marked for delete
2015-05-20 20:28:28,874 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first] sink oldest modified date: Wed Dec 31 15:59:59 PST 1969
2015-05-20 20:28:28,877 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first] starting
2015-05-20 20:28:28,877 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first]  source: MultiSourceTap[2:[GlobHfs[/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/?{ppe[_r]}.txt], GlobHfs[/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/?{owe?}.txt]]]
2015-05-20 20:28:28,878 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/globmultisource"]
2015-05-20 20:28:28,878 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first]  parallel execution is enabled: true
2015-05-20 20:28:28,878 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first]  starting jobs: 1
2015-05-20 20:28:28,878 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [first]  allocating threads: 1
2015-05-20 20:28:28,879 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [first] starting step: (1/1) ...pplatform/globmultisource
2015-05-20 20:28:28,994 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [first] submitted hadoop job: job_1432178820719_0006
2015-05-20 20:28:28,994 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [first] tracking url: http://Edinburgh.local:56621/proxy/application_1432178820719_0006/
2015-05-20 20:28:45,800 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0006_01_000007 is : 143
2015-05-20 20:28:45,971 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0006_01_000006 is : 143
2015-05-20 20:28:46,163 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0006_01_000005 is : 143
2015-05-20 20:28:46,203 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0006_01_000003 is : 143
2015-05-20 20:28:46,271 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0006_01_000004 is : 143
2015-05-20 20:28:46,293 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0006_01_000002 is : 143
2015-05-20 20:28:47,474 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/globmultisource/_temporary
2015-05-20 20:28:47,475 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first+second] completed flow: first
2015-05-20 20:28:47,475 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first+second] starting flow: second
2015-05-20 20:28:47,476 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second] at least one sink is marked for delete
2015-05-20 20:28:47,476 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second] sink oldest modified date: Wed Dec 31 15:59:59 PST 1969
2015-05-20 20:28:47,478 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second] starting
2015-05-20 20:28:47,478 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/globmultisource"]
2015-05-20 20:28:47,479 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/globmultiource2"]
2015-05-20 20:28:47,479 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second]  parallel execution is enabled: true
2015-05-20 20:28:47,479 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second]  starting jobs: 1
2015-05-20 20:28:47,479 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [second]  allocating threads: 1
2015-05-20 20:28:47,480 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [second] starting step: (1/1) ...pplatform/globmultiource2
2015-05-20 20:28:47,614 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [second] submitted hadoop job: job_1432178820719_0007
2015-05-20 20:28:47,614 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [second] tracking url: http://Edinburgh.local:56621/proxy/application_1432178820719_0007/
2015-05-20 20:29:07,890 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0007_01_000008 is : 143
2015-05-20 20:29:07,907 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0007_01_000005 is : 143
2015-05-20 20:29:07,997 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0007_01_000009 is : 143
2015-05-20 20:29:08,144 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0007_01_000003 is : 143
2015-05-20 20:29:08,173 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0007_01_000004 is : 143
2015-05-20 20:29:08,195 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0007_01_000006 is : 143
2015-05-20 20:29:08,203 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0007_01_000002 is : 143
2015-05-20 20:29:08,310 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0007_01_000007 is : 143
2015-05-20 20:29:09,512 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/globmultiource2/_temporary
2015-05-20 20:29:09,513 INFO  cascade.Cascade (Cascade.java:logInfo(996)) - [first+second] completed flow: second
2015-05-20 20:29:09,535 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/hadooptapplatform/globmultisource
2015-05-20 20:29:09,549 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/hadooptapplatform/globmultiource2
2015-05-20 20:29:09,619 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:29:09,619 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:29:09,633 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test] starting
2015-05-20 20:29:09,633 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt"]
2015-05-20 20:29:09,633 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  sink: ["TextDelimited[['ip', 'count']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/preparewritetapfail"]
2015-05-20 20:29:09,634 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  parallel execution is enabled: true
2015-05-20 20:29:09,634 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  starting jobs: 1
2015-05-20 20:29:09,634 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  allocating threads: 1
2015-05-20 20:29:09,635 ERROR flow.FlowStep (BaseFlowStep.java:logError(910)) - [test] unable to prepare tap for write: hdfs://localhost:56600/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/preparewritetapfail
java.io.IOException: failed intentionally
	at cascading.tap.hadoop.HadoopTapPlatformTest$7.prepareResourceForWrite(HadoopTapPlatformTest.java:849)
	at cascading.tap.hadoop.HadoopTapPlatformTest$7.prepareResourceForWrite(HadoopTapPlatformTest.java:845)
	at cascading.flow.planner.BaseFlowStep.prepareResource(BaseFlowStep.java:456)
	at cascading.flow.planner.BaseFlowStep.prepareResources(BaseFlowStep.java:438)
	at cascading.flow.planner.BaseFlowStep.prepareResources(BaseFlowStep.java:424)
	at cascading.flow.planner.FlowStepJob.prepareResources(FlowStepJob.java:188)
	at cascading.flow.planner.FlowStepJob.start(FlowStepJob.java:158)
	at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:124)
	at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:43)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2015-05-20 20:29:09,638 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test] stopping all jobs
2015-05-20 20:29:09,638 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [test] stopping: (1/1) ...tform/preparewritetapfail
2015-05-20 20:29:09,638 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test] stopped all jobs
2015-05-20 20:29:09,639 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/hadooptapplatform/preparewritetapfail
2015-05-20 20:29:09,649 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:29:09,650 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:29:09,660 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test] starting
2015-05-20 20:29:09,660 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  source: ["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt"]
2015-05-20 20:29:09,660 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  sink: Hfs["TextDelimited[['ip', 'count']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/preparereadtapfail"]
2015-05-20 20:29:09,660 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  parallel execution is enabled: true
2015-05-20 20:29:09,661 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  starting jobs: 1
2015-05-20 20:29:09,661 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  allocating threads: 1
2015-05-20 20:29:09,662 ERROR flow.FlowStep (BaseFlowStep.java:logError(910)) - [test] unable to prepare tap for read: hdfs://localhost:56600/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt
java.io.IOException: failed intentionally
	at cascading.tap.hadoop.HadoopTapPlatformTest$6.prepareResourceForRead(HadoopTapPlatformTest.java:801)
	at cascading.tap.hadoop.HadoopTapPlatformTest$6.prepareResourceForRead(HadoopTapPlatformTest.java:797)
	at cascading.flow.planner.BaseFlowStep.prepareResource(BaseFlowStep.java:458)
	at cascading.flow.planner.BaseFlowStep.prepareResources(BaseFlowStep.java:438)
	at cascading.flow.planner.BaseFlowStep.prepareResources(BaseFlowStep.java:421)
	at cascading.flow.planner.FlowStepJob.prepareResources(FlowStepJob.java:188)
	at cascading.flow.planner.FlowStepJob.start(FlowStepJob.java:158)
	at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:124)
	at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:43)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2015-05-20 20:29:09,662 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test] stopping all jobs
2015-05-20 20:29:09,662 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [test] stopping: (1/1) ...atform/preparereadtapfail
2015-05-20 20:29:09,663 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test] stopped all jobs
2015-05-20 20:29:09,664 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/hadooptapplatform/preparereadtapfail
2015-05-20 20:29:09,674 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:29:09,675 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:29:09,685 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test] starting
2015-05-20 20:29:09,685 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt"]
2015-05-20 20:29:09,685 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  sink: ["TextDelimited[['ip', 'count']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/committapfail"]
2015-05-20 20:29:09,686 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  parallel execution is enabled: true
2015-05-20 20:29:09,686 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  starting jobs: 1
2015-05-20 20:29:09,686 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  allocating threads: 1
2015-05-20 20:29:09,686 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [test] starting step: (1/1) ...tapplatform/committapfail
2015-05-20 20:29:09,801 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [test] submitted hadoop job: job_1432178820719_0008
2015-05-20 20:29:09,801 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [test] tracking url: http://Edinburgh.local:56621/proxy/application_1432178820719_0008/
2015-05-20 20:29:23,128 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0008_01_000002 is : 143
2015-05-20 20:29:23,157 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0008_01_000005 is : 143
2015-05-20 20:29:23,186 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0008_01_000004 is : 143
2015-05-20 20:29:23,202 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0008_01_000003 is : 143
2015-05-20 20:29:27,917 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0008_01_000006 is : 143
2015-05-20 20:29:29,035 ERROR flow.FlowStep (BaseFlowStep.java:logError(910)) - [test] unable to commit sink: hdfs://localhost:56600/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/committapfail
java.io.IOException: failed intentionally
	at cascading.tap.hadoop.HadoopTapPlatformTest$2.commitResource(HadoopTapPlatformTest.java:406)
	at cascading.tap.hadoop.HadoopTapPlatformTest$2.commitResource(HadoopTapPlatformTest.java:402)
	at cascading.flow.planner.BaseFlowStep.commitResource(BaseFlowStep.java:502)
	at cascading.flow.planner.BaseFlowStep.commitSinks(BaseFlowStep.java:490)
	at cascading.flow.planner.FlowStepJob.blockOnJob(FlowStepJob.java:267)
	at cascading.flow.planner.FlowStepJob.start(FlowStepJob.java:162)
	at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:124)
	at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:43)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2015-05-20 20:29:29,060 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test] stopping all jobs
2015-05-20 20:29:29,061 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [test] stopping: (1/1) ...tapplatform/committapfail
2015-05-20 20:29:29,062 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test] stopped all jobs
2015-05-20 20:29:29,064 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/committapfail/_temporary
2015-05-20 20:29:29,065 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/hadooptapplatform/committapfail
2015-05-20 20:29:29,081 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:29:29,082 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:29:29,092 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test] starting
2015-05-20 20:29:29,093 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt"]
2015-05-20 20:29:29,093 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  sink: ["TextDelimited[['ip', 'count']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/committap"]
2015-05-20 20:29:29,093 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  parallel execution is enabled: true
2015-05-20 20:29:29,093 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  starting jobs: 1
2015-05-20 20:29:29,093 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [test]  allocating threads: 1
2015-05-20 20:29:29,094 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [test] starting step: (1/1) ...dooptapplatform/committap
2015-05-20 20:29:29,197 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [test] submitted hadoop job: job_1432178820719_0009
2015-05-20 20:29:29,198 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [test] tracking url: http://Edinburgh.local:56621/proxy/application_1432178820719_0009/
2015-05-20 20:29:42,417 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0009_01_000003 is : 143
2015-05-20 20:29:42,463 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0009_01_000002 is : 143
2015-05-20 20:29:42,478 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0009_01_000004 is : 143
2015-05-20 20:29:42,542 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0009_01_000005 is : 143
2015-05-20 20:29:47,510 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0009_01_000006 is : 143
2015-05-20 20:29:48,666 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/committap/_temporary
2015-05-20 20:29:48,679 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/hadooptapplatform/committap
2015-05-20 20:29:48,700 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:setupTask(98)) - setting up task: 'attempt_002147483647_0000_m_000000_0' - hdfs://localhost:56600/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/multifiles/A/_temporary/_attempt_002147483647_0000_m_000000_0
2015-05-20 20:29:48,701 INFO  io.TapOutputCollector (TapOutputCollector.java:initialize(112)) - creating path: part-00000
2015-05-20 20:29:48,703 INFO  io.TapOutputCollector (TapOutputCollector.java:close(145)) - closing tap collector for: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/multifiles/A/part-00000
2015-05-20 20:29:48,713 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(155)) - committing task: 'attempt_002147483647_0000_m_000000_0' - hdfs://localhost:56600/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/multifiles/A/_temporary/_attempt_002147483647_0000_m_000000_0
2015-05-20 20:29:48,718 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(172)) - saved output of task 'attempt_002147483647_0000_m_000000_0' to hdfs://localhost:56600/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/multifiles/A
2015-05-20 20:29:48,719 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path hdfs://localhost:56600/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/multifiles/A/_temporary
2015-05-20 20:29:48,724 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:setupTask(98)) - setting up task: 'attempt_002147483647_0000_m_000000_0' - hdfs://localhost:56600/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/multifiles/B/_temporary/_attempt_002147483647_0000_m_000000_0
2015-05-20 20:29:48,725 INFO  io.TapOutputCollector (TapOutputCollector.java:initialize(112)) - creating path: part-00000
2015-05-20 20:29:48,727 INFO  io.TapOutputCollector (TapOutputCollector.java:close(145)) - closing tap collector for: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/multifiles/B/part-00000
2015-05-20 20:29:48,737 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(155)) - committing task: 'attempt_002147483647_0000_m_000000_0' - hdfs://localhost:56600/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/multifiles/B/_temporary/_attempt_002147483647_0000_m_000000_0
2015-05-20 20:29:48,743 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(172)) - saved output of task 'attempt_002147483647_0000_m_000000_0' to hdfs://localhost:56600/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/multifiles/B
2015-05-20 20:29:48,743 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path hdfs://localhost:56600/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/multifiles/B/_temporary
2015-05-20 20:29:48,775 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:setupTask(98)) - setting up task: 'attempt_002147483647_0000_m_000000_0' - hdfs://localhost:56600/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/hiddenfiles/A/_temporary/_attempt_002147483647_0000_m_000000_0
2015-05-20 20:29:48,775 INFO  io.TapOutputCollector (TapOutputCollector.java:initialize(112)) - creating path: part-00000
2015-05-20 20:29:48,778 INFO  io.TapOutputCollector (TapOutputCollector.java:close(145)) - closing tap collector for: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/hiddenfiles/A/part-00000
2015-05-20 20:29:48,788 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(155)) - committing task: 'attempt_002147483647_0000_m_000000_0' - hdfs://localhost:56600/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/hiddenfiles/A/_temporary/_attempt_002147483647_0000_m_000000_0
2015-05-20 20:29:48,794 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(172)) - saved output of task 'attempt_002147483647_0000_m_000000_0' to hdfs://localhost:56600/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/hiddenfiles/A
2015-05-20 20:29:48,795 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path hdfs://localhost:56600/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/hiddenfiles/A/_temporary
2015-05-20 20:29:48,798 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:setupTask(98)) - setting up task: 'attempt_002147483647_0000_m_000000_0' - hdfs://localhost:56600/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/hiddenfiles/B/_temporary/_attempt_002147483647_0000_m_000000_0
2015-05-20 20:29:48,799 INFO  io.TapOutputCollector (TapOutputCollector.java:initialize(112)) - creating path: part-00000
2015-05-20 20:29:48,801 INFO  io.TapOutputCollector (TapOutputCollector.java:close(145)) - closing tap collector for: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/hiddenfiles/B/part-00000
2015-05-20 20:29:48,810 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(155)) - committing task: 'attempt_002147483647_0000_m_000000_0' - hdfs://localhost:56600/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/hiddenfiles/B/_temporary/_attempt_002147483647_0000_m_000000_0
2015-05-20 20:29:48,815 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(172)) - saved output of task 'attempt_002147483647_0000_m_000000_0' to hdfs://localhost:56600/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/hiddenfiles/B
2015-05-20 20:29:48,815 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path hdfs://localhost:56600/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/hiddenfiles/B/_temporary
2015-05-20 20:29:48,819 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:setupTask(98)) - setting up task: 'attempt_002147483647_0000_m_000000_0' - hdfs://localhost:56600/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/hiddenfiles/.hidden/_temporary/_attempt_002147483647_0000_m_000000_0
2015-05-20 20:29:48,820 INFO  io.TapOutputCollector (TapOutputCollector.java:initialize(112)) - creating path: part-00000
2015-05-20 20:29:48,822 INFO  io.TapOutputCollector (TapOutputCollector.java:close(145)) - closing tap collector for: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/hiddenfiles/.hidden/part-00000
2015-05-20 20:29:48,834 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(155)) - committing task: 'attempt_002147483647_0000_m_000000_0' - hdfs://localhost:56600/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/hiddenfiles/.hidden/_temporary/_attempt_002147483647_0000_m_000000_0
2015-05-20 20:29:48,841 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(172)) - saved output of task 'attempt_002147483647_0000_m_000000_0' to hdfs://localhost:56600/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/hiddenfiles/.hidden
2015-05-20 20:29:48,842 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path hdfs://localhost:56600/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/hiddenfiles/.hidden/_temporary
2015-05-20 20:29:48,851 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/hadooptapplatform/hiddenfiles/.hidden
2015-05-20 20:29:48,856 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/hadooptapplatform/hiddenfiles/B
2015-05-20 20:29:48,860 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/hadooptapplatform/hiddenfiles/A
2015-05-20 20:29:48,865 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/hadooptapplatform/multifiles
2015-05-20 20:29:48,874 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/hadooptapplatform/hiddenfiles
2015-05-20 20:29:48,878 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/hadooptapplatform/multifiles/A
2015-05-20 20:29:48,883 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/hadooptapplatform/multifiles/B
2015-05-20 20:29:48,904 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:29:48,904 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:29:48,917 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [partition] starting
2015-05-20 20:29:48,918 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [partition]  source: Hfs["TextDelimited[['number', 'lower']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-05-20 20:29:48,918 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [partition]  sink: PartitionTap["Hfs["TextDelimited[['lower']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/combinedpartition/partitioned"]"]["cascading.tap.partition.DelimitedPartition@4b96ace0"]
2015-05-20 20:29:48,918 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [partition]  parallel execution is enabled: true
2015-05-20 20:29:48,918 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [partition]  starting jobs: 1
2015-05-20 20:29:48,918 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [partition]  allocating threads: 1
2015-05-20 20:29:48,920 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [partition] starting step: (1/1) ...inedpartition/partitioned
2015-05-20 20:29:49,020 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [partition] submitted hadoop job: job_1432178820719_0010
2015-05-20 20:29:49,020 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [partition] tracking url: http://Edinburgh.local:56621/proxy/application_1432178820719_0010/
2015-05-20 20:30:04,550 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0010_01_000006 is : 143
2015-05-20 20:30:04,669 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0010_01_000004 is : 143
2015-05-20 20:30:04,757 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0010_01_000005 is : 143
2015-05-20 20:30:04,884 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0010_01_000002 is : 143
2015-05-20 20:30:05,031 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0010_01_000003 is : 143
2015-05-20 20:30:06,184 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/combinedpartition/partitioned/_temporary
2015-05-20 20:30:06,195 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-05-20 20:30:06,195 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(226)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.7.0/8b73ff12892507d12477c4f1b7607a122ddc5528/cascading-hadoop2-mr1-2.7.0.jar
2015-05-20 20:30:06,205 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [copy] starting
2015-05-20 20:30:06,205 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [copy]  source: PartitionTap["Hfs["TextDelimited[['lower']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/combinedpartition/partitioned"]"]["cascading.tap.partition.DelimitedPartition@4b96ace0"]
2015-05-20 20:30:06,206 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [copy]  sink: Hfs["TextDelimited[['number', 'lower']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/combinedpartition/final"]
2015-05-20 20:30:06,206 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [copy]  parallel execution is enabled: true
2015-05-20 20:30:06,206 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [copy]  starting jobs: 1
2015-05-20 20:30:06,206 INFO  flow.Flow (BaseFlow.java:logInfo(1370)) - [copy]  allocating threads: 1
2015-05-20 20:30:06,207 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [copy] starting step: (1/1) ...m/combinedpartition/final
2015-05-20 20:30:06,321 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [copy] submitted hadoop job: job_1432178820719_0011
2015-05-20 20:30:06,322 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(895)) - [copy] tracking url: http://Edinburgh.local:56621/proxy/application_1432178820719_0011/
2015-05-20 20:30:14,682 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1432178820719_0011_01_000002 is : 143
2015-05-20 20:30:15,852 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/hadooptapplatform/combinedpartition/final/_temporary
2015-05-20 20:30:15,867 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/hadooptapplatform/combinedpartition/final
2015-05-20 20:30:15,872 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/hadooptapplatform/combinedpartition/partitioned

Standard error

May 20, 2015 8:27:02 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class
May 20, 2015 8:27:02 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class
May 20, 2015 8:27:02 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 20, 2015 8:27:02 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 20, 2015 8:27:02 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 20, 2015 8:27:03 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 20, 2015 8:27:03 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 20, 2015 8:27:03 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 20, 2015 8:27:03 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
May 20, 2015 8:27:03 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 20, 2015 8:27:03 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
May 20, 2015 8:27:03 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 20, 2015 8:27:03 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 20, 2015 8:27:03 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 20, 2015 8:27:03 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 20, 2015 8:27:04 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 20, 2015 8:27:04 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
May 20, 2015 8:27:04 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 20, 2015 8:27:04 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
May 20, 2015 8:27:04 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 20, 2015 8:27:04 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 20, 2015 8:27:04 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 20, 2015 8:27:05 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 20, 2015 8:27:05 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 20, 2015 8:27:06 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
May 20, 2015 8:27:06 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 20, 2015 8:27:06 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
May 20, 2015 8:27:06 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 20, 2015 8:27:06 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 20, 2015 8:27:06 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 20, 2015 8:27:06 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 20, 2015 8:27:06 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 20, 2015 8:27:07 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
May 20, 2015 8:27:07 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 20, 2015 8:27:07 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
May 20, 2015 8:27:07 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 20, 2015 8:27:07 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 20, 2015 8:27:07 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 20, 2015 8:27:07 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 20, 2015 8:27:07 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.