Class cascading.stats.hadoop.CascadingStatsLocalHadoopErrorPlatformTest

2

tests

0

failures

0

ignored

11.953s

duration

100%

successful

Tests

Test Duration Result
testLocalErrorReportingInMapper 5.316s passed
testLocalErrorReportingInReducer 6.637s passed

Standard output

2015-07-21 12:33:35,958 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(195)) - found 1 test platforms from classpath
2015-07-21 12:33:35,975 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(244)) - adding test: cascading.stats.hadoop.CascadingStatsLocalHadoopErrorPlatformTest, with platform: hadoop2-mr1
2015-07-21 12:33:36,374 INFO  util.Util (Util.java:findMainClass(1325)) - using default application jar, may cause class not found exceptions on the cluster
2015-07-21 12:33:36,375 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /Users/castillo/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.1/616db6028856ef10fd9ffb4ebd59ea94589475c4/cascading-hadoop2-mr1-3.0.1.jar
2015-07-21 12:33:36,441 INFO  property.AppProps (AppProps.java:getAppID(174)) - using app.id: 534E574CEBEF4A3EB05C9B41B6DB64C2
2015-07-21 12:33:36,654 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2015-07-21 12:33:36,872 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [reducer fail test] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.087
2015-07-21 12:33:36,875 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [reducer fail test] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 2
2015-07-21 12:33:36,875 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [reducer fail test] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-07-21 12:33:36,971 INFO  util.Version (Version.java:printBanner(81)) - Concurrent, Inc - Cascading 3.0.1
2015-07-21 12:33:36,971 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [reducer fail test] starting
2015-07-21 12:33:36,974 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [reducer fail test]  parallel execution of flows is enabled: false
2015-07-21 12:33:36,974 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [reducer fail test]  executing total flows: 1
2015-07-21 12:33:36,974 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [reducer fail test]  allocating management threads: 1
2015-07-21 12:33:36,975 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [reducer fail test] starting flow: reducer fail test
2015-07-21 12:33:36,975 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [reducer fail test] at least one sink is marked for delete
2015-07-21 12:33:36,978 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [reducer fail test] sink oldest modified date: Wed Dec 31 15:59:59 PST 1969
2015-07-21 12:33:37,042 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [reducer fail test] starting
2015-07-21 12:33:37,042 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [reducer fail test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/classes/test/data/apache.10.txt"]
2015-07-21 12:33:37,043 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [reducer fail test]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/cascadingstatslocalhadooperrorplatform/testLocalErrorReportingInReducer/reducerfail"]
2015-07-21 12:33:37,043 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [reducer fail test]  parallel execution of steps is enabled: false
2015-07-21 12:33:37,043 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [reducer fail test]  executing total steps: 1
2015-07-21 12:33:37,043 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [reducer fail test]  allocating management threads: 1
2015-07-21 12:33:37,044 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [reducer fail test] starting step: (1/1) ...tingInReducer/reducerfail
2015-07-21 12:33:37,607 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [reducer fail test] submitted hadoop job: job_local1431445729_0001
2015-07-21 12:33:37,608 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [reducer fail test] tracking url: http://localhost:8080/
2015-07-21 12:33:37,675 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/classes/test/data/apache.10.txt
2015-07-21 12:33:37,757 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.1
2015-07-21 12:33:37,758 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-07-21 12:33:37,765 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: FA6661FEB1DC4EE08F5D73320A23A417, ordinal: 0
2015-07-21 12:33:37,813 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/classes/test/data/apache.10.txt"]
2015-07-21 12:33:37,814 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: GroupBy(failing reducer)[by:[{1}:'ip']]
2015-07-21 12:33:37,814 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FA6661FEB1DC4EE08F5D73320A23A417, mem on start (mb), free: 133, total: 245, max: 672
2015-07-21 12:33:37,823 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: FA6661FEB1DC4EE08F5D73320A23A417, mem on close (mb), free: 132, total: 245, max: 672
2015-07-21 12:33:37,918 INFO  hadoop.FlowReducer (FlowReducer.java:configure(83)) - cascading version: 3.0.1
2015-07-21 12:33:37,919 INFO  hadoop.FlowReducer (FlowReducer.java:configure(84)) - child jvm opts: -Xmx200m
2015-07-21 12:33:37,927 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - flow node id: A1297679C25040BDAE5DC42BC12104C9, ordinal: 1
2015-07-21 12:33:37,930 INFO  hadoop.FlowReducer (FlowReducer.java:configure(104)) - sourcing from: GroupBy(failing reducer)[by:[{1}:'ip']]
2015-07-21 12:33:37,930 INFO  hadoop.FlowReducer (FlowReducer.java:configure(107)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/cascadingstatslocalhadooperrorplatform/testLocalErrorReportingInReducer/reducerfail"]
2015-07-21 12:33:37,930 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A1297679C25040BDAE5DC42BC12104C9, mem on start (mb), free: 118, total: 245, max: 672
2015-07-21 12:33:37,947 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.pipe.OperatorException: [failing reducer][cascading.stats.hadoop.CascadingStatsLocalHadoopErrorPlatformTest.testLocalErrorReportingInReducer(CascadingStatsLocalHadoopErrorPlatformTest.java:124)] operator Every failed executing operation: TestFailAggregator[decl:'count']
	at cascading.flow.stream.element.AggregatorEveryStage.receive(AggregatorEveryStage.java:138)
	at cascading.flow.stream.element.AggregatorEveryStage.receive(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:49)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: failed
	at cascading.TestFailAggregator.aggregate(TestFailAggregator.java:54)
	at cascading.flow.stream.element.AggregatorEveryStage.receive(AggregatorEveryStage.java:130)
	... 13 more
2015-07-21 12:33:37,949 INFO  hadoop.FlowReducer (LogUtil.java:logMemory(59)) - flow node id: A1297679C25040BDAE5DC42BC12104C9, mem on close (mb), free: 116, total: 245, max: 672
2015-07-21 12:33:37,951 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1431445729_0001
java.lang.Exception: cascading.pipe.OperatorException: [failing reducer][cascading.stats.hadoop.CascadingStatsLocalHadoopErrorPlatformTest.testLocalErrorReportingInReducer(CascadingStatsLocalHadoopErrorPlatformTest.java:124)] operator Every failed executing operation: TestFailAggregator[decl:'count']
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.pipe.OperatorException: [failing reducer][cascading.stats.hadoop.CascadingStatsLocalHadoopErrorPlatformTest.testLocalErrorReportingInReducer(CascadingStatsLocalHadoopErrorPlatformTest.java:124)] operator Every failed executing operation: TestFailAggregator[decl:'count']
	at cascading.flow.stream.element.AggregatorEveryStage.receive(AggregatorEveryStage.java:138)
	at cascading.flow.stream.element.AggregatorEveryStage.receive(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:49)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: failed
	at cascading.TestFailAggregator.aggregate(TestFailAggregator.java:54)
	at cascading.flow.stream.element.AggregatorEveryStage.receive(AggregatorEveryStage.java:130)
	... 13 more
2015-07-21 12:33:42,612 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [reducer fail test] hadoop job job_local1431445729_0001 state at FAILED
2015-07-21 12:33:42,613 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [reducer fail test] failure info: NA
2015-07-21 12:33:42,614 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [reducer fail test] task completion events identify failed tasks
2015-07-21 12:33:42,614 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [reducer fail test] task completion events count: 0
2015-07-21 12:33:42,626 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [reducer fail test] stopping all jobs
2015-07-21 12:33:42,626 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [reducer fail test] stopping: (1/1) ...tingInReducer/reducerfail
2015-07-21 12:33:42,626 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [reducer fail test] stopped all jobs
2015-07-21 12:33:42,629 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/cascadingstatslocalhadooperrorplatform/testLocalErrorReportingInReducer/reducerfail/_temporary
2015-07-21 12:33:42,629 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [reducer fail test]  completed in: 00:05.585
2015-07-21 12:33:42,629 WARN  cascade.Cascade (BaseCascade.java:logWarn(878)) - [reducer fail test] flow failed: reducer fail test
cascading.flow.FlowException: local step failed: (1/1) ...tingInReducer/reducerfail
	at cascading.flow.planner.FlowStepJob.blockOnJob(FlowStepJob.java:272)
	at cascading.flow.planner.FlowStepJob.start(FlowStepJob.java:172)
	at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:134)
	at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:45)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.pipe.OperatorException: [failing reducer][cascading.stats.hadoop.CascadingStatsLocalHadoopErrorPlatformTest.testLocalErrorReportingInReducer(CascadingStatsLocalHadoopErrorPlatformTest.java:124)] operator Every failed executing operation: TestFailAggregator[decl:'count']
	at cascading.flow.stream.element.AggregatorEveryStage.receive(AggregatorEveryStage.java:138)
	at cascading.flow.stream.element.AggregatorEveryStage.receive(AggregatorEveryStage.java:41)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:49)
	at cascading.flow.stream.duct.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.accept(HadoopGroupGate.java:141)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:146)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
	... 4 more
Caused by: java.lang.RuntimeException: failed
	at cascading.TestFailAggregator.aggregate(TestFailAggregator.java:54)
	at cascading.flow.stream.element.AggregatorEveryStage.receive(AggregatorEveryStage.java:130)
	... 13 more
2015-07-21 12:33:42,630 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [reducer fail test] stopping all flows
2015-07-21 12:33:42,630 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [reducer fail test] stopping flow: reducer fail test
2015-07-21 12:33:42,630 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [reducer fail test] stopping all jobs
2015-07-21 12:33:42,631 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [reducer fail test] stopping: (1/1) ...tingInReducer/reducerfail
2015-07-21 12:33:42,631 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [reducer fail test] stopped all jobs
2015-07-21 12:33:42,631 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [reducer fail test] stopped all flows
2015-07-21 12:33:42,649 INFO  util.Util (Util.java:findMainClass(1325)) - using default application jar, may cause class not found exceptions on the cluster
2015-07-21 12:33:42,649 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(174)) - using application jar: /Users/castillo/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/3.0.1/616db6028856ef10fd9ffb4ebd59ea94589475c4/cascading-hadoop2-mr1-3.0.1.jar
2015-07-21 12:33:42,688 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mapper fail test] executed rule registry: MapReduceHadoopRuleRegistry, completed as: SUCCESS, in: 00:00.034
2015-07-21 12:33:42,690 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mapper fail test] rule registry: MapReduceHadoopRuleRegistry, supports assembly with steps: 1, nodes: 1
2015-07-21 12:33:42,690 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mapper fail test] rule registry: MapReduceHadoopRuleRegistry, result was selected using: 'default comparator: selects plan with fewest steps and fewest nodes'
2015-07-21 12:33:42,704 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [mapper fail test] starting
2015-07-21 12:33:42,705 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [mapper fail test]  parallel execution of flows is enabled: false
2015-07-21 12:33:42,705 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [mapper fail test]  executing total flows: 1
2015-07-21 12:33:42,705 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [mapper fail test]  allocating management threads: 1
2015-07-21 12:33:42,705 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [mapper fail test] starting flow: mapper fail test
2015-07-21 12:33:42,706 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mapper fail test] at least one sink is marked for delete
2015-07-21 12:33:42,706 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mapper fail test] sink oldest modified date: Wed Dec 31 15:59:59 PST 1969
2015-07-21 12:33:42,713 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mapper fail test] starting
2015-07-21 12:33:42,713 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mapper fail test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/classes/test/data/apache.10.txt"]
2015-07-21 12:33:42,713 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mapper fail test]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/cascadingstatslocalhadooperrorplatform/testLocalErrorReportingInMapper/mapperfail"]
2015-07-21 12:33:42,714 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mapper fail test]  parallel execution of steps is enabled: false
2015-07-21 12:33:42,714 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mapper fail test]  executing total steps: 1
2015-07-21 12:33:42,714 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mapper fail test]  allocating management threads: 1
2015-07-21 12:33:42,714 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mapper fail test] starting step: (1/1) ...ortingInMapper/mapperfail
2015-07-21 12:33:42,935 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mapper fail test] submitted hadoop job: job_local996993727_0002
2015-07-21 12:33:42,936 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mapper fail test] tracking url: http://localhost:8080/
2015-07-21 12:33:42,942 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/classes/test/data/apache.10.txt
2015-07-21 12:33:42,956 INFO  hadoop.FlowMapper (FlowMapper.java:configure(75)) - cascading version: 3.0.1
2015-07-21 12:33:42,956 INFO  hadoop.FlowMapper (FlowMapper.java:configure(76)) - child jvm opts: -Xmx200m
2015-07-21 12:33:42,964 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - flow node id: B7800C790FEE4ADC8C4E5A4AE2CE265E, ordinal: 0
2015-07-21 12:33:42,965 INFO  hadoop.FlowMapper (FlowMapper.java:configure(94)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/classes/test/data/apache.10.txt"]
2015-07-21 12:33:42,965 INFO  hadoop.FlowMapper (FlowMapper.java:configure(97)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/cascadingstatslocalhadooperrorplatform/testLocalErrorReportingInMapper/mapperfail"]
2015-07-21 12:33:42,965 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B7800C790FEE4ADC8C4E5A4AE2CE265E, mem on start (mb), free: 196, total: 310, max: 672
2015-07-21 12:33:42,966 ERROR element.TrapHandler (TrapHandler.java:handleReThrowableException(115)) - caught Throwable, no trap available, rethrowing
cascading.CascadingException: testing
	at cascading.stats.hadoop.CascadingStatsLocalHadoopErrorPlatformTest$FailFunction.operate(CascadingStatsLocalHadoopErrorPlatformTest.java:81)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.hadoop.FlowMapper.run(FlowMapper.java:142)
	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2015-07-21 12:33:42,966 ERROR element.SourceStage (SourceStage.java:map(118)) - caught throwable
cascading.CascadingException: testing
	at cascading.stats.hadoop.CascadingStatsLocalHadoopErrorPlatformTest$FailFunction.operate(CascadingStatsLocalHadoopErrorPlatformTest.java:81)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.hadoop.FlowMapper.run(FlowMapper.java:142)
	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2015-07-21 12:33:42,967 INFO  hadoop.FlowMapper (LogUtil.java:logMemory(59)) - flow node id: B7800C790FEE4ADC8C4E5A4AE2CE265E, mem on close (mb), free: 196, total: 310, max: 672
2015-07-21 12:33:42,969 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local996993727_0002
java.lang.Exception: cascading.CascadingException: testing
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
Caused by: cascading.CascadingException: testing
	at cascading.stats.hadoop.CascadingStatsLocalHadoopErrorPlatformTest$FailFunction.operate(CascadingStatsLocalHadoopErrorPlatformTest.java:81)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.hadoop.FlowMapper.run(FlowMapper.java:142)
	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2015-07-21 12:33:47,941 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [mapper fail test] hadoop job job_local996993727_0002 state at FAILED
2015-07-21 12:33:47,942 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [mapper fail test] failure info: NA
2015-07-21 12:33:47,943 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [mapper fail test] task completion events identify failed tasks
2015-07-21 12:33:47,943 WARN  flow.Flow (BaseFlow.java:logWarn(1445)) - [mapper fail test] task completion events count: 0
2015-07-21 12:33:47,944 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mapper fail test] stopping all jobs
2015-07-21 12:33:47,945 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mapper fail test] stopping: (1/1) ...ortingInMapper/mapperfail
2015-07-21 12:33:47,945 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mapper fail test] stopped all jobs
2015-07-21 12:33:47,946 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(226)) - deleting temp path /Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/build/test/output/hadoop2-mr1/cascadingstatslocalhadooperrorplatform/testLocalErrorReportingInMapper/mapperfail/_temporary
2015-07-21 12:33:47,946 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mapper fail test]  completed in: 00:05.232
2015-07-21 12:33:47,946 WARN  cascade.Cascade (BaseCascade.java:logWarn(878)) - [mapper fail test] flow failed: mapper fail test
cascading.flow.FlowException: local step failed: (1/1) ...ortingInMapper/mapperfail
	at cascading.flow.planner.FlowStepJob.blockOnJob(FlowStepJob.java:272)
	at cascading.flow.planner.FlowStepJob.start(FlowStepJob.java:172)
	at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:134)
	at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:45)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
Caused by: cascading.CascadingException: testing
	at cascading.stats.hadoop.CascadingStatsLocalHadoopErrorPlatformTest$FailFunction.operate(CascadingStatsLocalHadoopErrorPlatformTest.java:81)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:100)
	at cascading.flow.stream.element.FunctionEachStage.receive(FunctionEachStage.java:40)
	at cascading.flow.stream.element.SourceStage.map(SourceStage.java:110)
	at cascading.flow.stream.element.SourceStage.run(SourceStage.java:66)
	at cascading.flow.hadoop.FlowMapper.run(FlowMapper.java:142)
	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
	... 4 more
2015-07-21 12:33:47,947 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [mapper fail test] stopping all flows
2015-07-21 12:33:47,947 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [mapper fail test] stopping flow: mapper fail test
2015-07-21 12:33:47,948 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mapper fail test] stopping all jobs
2015-07-21 12:33:47,948 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mapper fail test] stopping: (1/1) ...ortingInMapper/mapperfail
2015-07-21 12:33:47,948 INFO  flow.Flow (BaseFlow.java:logInfo(1433)) - [mapper fail test] stopped all jobs
2015-07-21 12:33:47,948 INFO  cascade.Cascade (BaseCascade.java:logInfo(860)) - [mapper fail test] stopped all flows

Standard error

SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/Users/castillo/code/cascading.compatibility/microsoft-hdi-3.2/hadoop/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/Users/castillo/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.5/6edffc576ce104ec769d954618764f39f0f0f10d/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]