2014-08-22 19:39:41,921 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(187)) - found 1 test platforms from classpath
2014-08-22 19:39:41,984 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(237)) - installing platform: hadoop2-mr1
2014-08-22 19:39:41,984 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(238)) - running test: cascading.stats.hadoop.CascadingStatsLocalHadoopErrorPlatformTest
2014-08-22 19:39:42,367 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2014-08-22 19:39:42,369 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.6/31997f144a2e73eebf04d45ed31402ee30118b2/cascading-hadoop2-mr1-2.5.6.jar
2014-08-22 19:39:42,392 INFO property.AppProps (AppProps.java:getAppID(162)) - using app.id: A9C54406E35542258B4CA094507D1DE1
2014-08-22 19:39:42,745 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2014-08-22 19:39:42,946 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-08-22 19:39:42,993 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-22 19:39:42,997 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-08-22 19:39:43,079 INFO util.Version (Version.java:printBanner(78)) - Concurrent, Inc - Cascading 2.5.6
2014-08-22 19:39:43,080 INFO cascade.Cascade (Cascade.java:logInfo(991)) - [reducer fail test] starting
2014-08-22 19:39:43,084 INFO cascade.Cascade (Cascade.java:logInfo(991)) - [reducer fail test] parallel execution is enabled: true
2014-08-22 19:39:43,084 INFO cascade.Cascade (Cascade.java:logInfo(991)) - [reducer fail test] starting flows: 1
2014-08-22 19:39:43,084 INFO cascade.Cascade (Cascade.java:logInfo(991)) - [reducer fail test] allocating threads: 1
2014-08-22 19:39:43,086 INFO cascade.Cascade (Cascade.java:logInfo(991)) - [reducer fail test] starting flow: reducer fail test
2014-08-22 19:39:43,090 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [reducer fail test] at least one sink is marked for delete
2014-08-22 19:39:43,096 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [reducer fail test] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2014-08-22 19:39:43,187 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [reducer fail test] starting
2014-08-22 19:39:43,188 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [reducer fail test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.2.x/build/classes/test/data/apache.10.txt"]
2014-08-22 19:39:43,189 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [reducer fail test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.2.x/build/test/output/hadoop2-mr1/cascadingstatslocalhadooperrorplatform/reducerfail"]
2014-08-22 19:39:43,189 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [reducer fail test] parallel execution is enabled: false
2014-08-22 19:39:43,189 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [reducer fail test] starting jobs: 1
2014-08-22 19:39:43,189 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [reducer fail test] allocating threads: 1
2014-08-22 19:39:43,190 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [reducer fail test] starting step: (1/1) ...errorplatform/reducerfail
2014-08-22 19:39:43,216 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - session.id is deprecated. Instead, use dfs.metrics.session-id
2014-08-22 19:39:43,217 INFO jvm.JvmMetrics (JvmMetrics.java:init(76)) - Initializing JVM Metrics with processName=JobTracker, sessionId=
2014-08-22 19:39:43,244 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 19:39:43,648 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2014-08-22 19:39:43,664 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-08-22 19:39:43,706 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2014-08-22 19:39:43,727 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2014-08-22 19:39:43,727 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2014-08-22 19:39:43,729 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2014-08-22 19:39:43,730 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2014-08-22 19:39:43,730 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2014-08-22 19:39:43,732 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2014-08-22 19:39:43,733 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2014-08-22 19:39:43,733 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2014-08-22 19:39:43,734 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2014-08-22 19:39:43,735 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2014-08-22 19:39:43,736 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2014-08-22 19:39:43,879 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local1297184606_0001
2014-08-22 19:39:43,928 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.2.x/build/test/tmp/mapred/staging/teamcity1297184606/.staging/job_local1297184606_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2014-08-22 19:39:43,929 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.2.x/build/test/tmp/mapred/staging/teamcity1297184606/.staging/job_local1297184606_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2014-08-22 19:39:44,127 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1297184606_0001/job_local1297184606_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2014-08-22 19:39:44,128 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1297184606_0001/job_local1297184606_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2014-08-22 19:39:44,143 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2014-08-22 19:39:44,145 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2014-08-22 19:39:44,148 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [reducer fail test] submitted hadoop job: job_local1297184606_0001
2014-08-22 19:39:44,148 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [reducer fail test] tracking url: http://localhost:8080/
2014-08-22 19:39:44,148 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-08-22 19:39:44,189 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2014-08-22 19:39:44,192 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local1297184606_0001_m_000000_0
2014-08-22 19:39:44,234 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2014-08-22 19:39:44,246 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.2.x/build/classes/test/data/apache.10.txt
2014-08-22 19:39:44,246 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@4d2f9924
2014-08-22 19:39:44,256 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 1
2014-08-22 19:39:44,264 INFO mapred.MapTask (MapTask.java:createSortingCollector(387)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2014-08-22 19:39:44,418 INFO mapred.MapTask (MapTask.java:setEquator(1183)) - (EQUATOR) 0 kvi 26214396(104857584)
2014-08-22 19:39:44,418 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2014-08-22 19:39:44,418 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2014-08-22 19:39:44,418 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2014-08-22 19:39:44,419 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2014-08-22 19:39:44,442 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.5.6
2014-08-22 19:39:44,442 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2014-08-22 19:39:44,492 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.partition is deprecated. Instead, use mapreduce.task.partition
2014-08-22 19:39:44,511 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.2.x/build/classes/test/data/apache.10.txt"]
2014-08-22 19:39:44,511 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(failing reducer)[by:[{1}:'ip']]
2014-08-22 19:39:44,527 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2014-08-22 19:39:44,528 INFO mapred.MapTask (MapTask.java:flush(1440)) - Starting flush of map output
2014-08-22 19:39:44,528 INFO mapred.MapTask (MapTask.java:flush(1459)) - Spilling map output
2014-08-22 19:39:44,528 INFO mapred.MapTask (MapTask.java:flush(1460)) - bufstart = 0; bufend = 210; bufvoid = 104857600
2014-08-22 19:39:44,528 INFO mapred.MapTask (MapTask.java:flush(1462)) - kvstart = 26214396(104857584); kvend = 26214360(104857440); length = 37/6553600
2014-08-22 19:39:44,542 INFO mapred.MapTask (MapTask.java:sortAndSpill(1648)) - Finished spill 0
2014-08-22 19:39:44,547 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1297184606_0001_m_000000_0 is done. And is in the process of committing
2014-08-22 19:39:44,555 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.2.x/build/classes/test/data/apache.10.txt:0+1449
2014-08-22 19:39:44,556 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1297184606_0001_m_000000_0' done.
2014-08-22 19:39:44,556 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(241)) - Finishing task: attempt_local1297184606_0001_m_000000_0
2014-08-22 19:39:44,556 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2014-08-22 19:39:44,571 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2014-08-22 19:39:44,578 INFO mapred.Merger (Merger.java:merge(568)) - Merging 1 sorted segments
2014-08-22 19:39:44,585 INFO mapred.Merger (Merger.java:merge(667)) - Down to the last merge-pass, with 1 segments left of total size: 211 bytes
2014-08-22 19:39:44,585 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) -
2014-08-22 19:39:44,587 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.5.6
2014-08-22 19:39:44,587 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2014-08-22 19:39:44,606 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(failing reducer)[by:[{1}:'ip']]
2014-08-22 19:39:44,607 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.2.x/build/test/output/hadoop2-mr1/cascadingstatslocalhadooperrorplatform/reducerfail"]
2014-08-22 19:39:44,633 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.pipe.OperatorException: [failing reducer][cascading.stats.hadoop.CascadingStatsLocalHadoopErrorPlatformTest.testLocalErrorReportingInReducer(CascadingStatsLocalHadoopErrorPlatformTest.java:124)] operator Every failed executing operation: TestFailAggregator[decl:'count']
at cascading.flow.stream.AggregatorEveryStage.receive(AggregatorEveryStage.java:136)
at cascading.flow.stream.AggregatorEveryStage.receive(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:49)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
Caused by: java.lang.RuntimeException: failed
at cascading.TestFailAggregator.aggregate(TestFailAggregator.java:54)
at cascading.flow.stream.AggregatorEveryStage.receive(AggregatorEveryStage.java:128)
... 8 more
2014-08-22 19:39:44,639 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(482)) - job_local1297184606_0001
cascading.pipe.OperatorException: [failing reducer][cascading.stats.hadoop.CascadingStatsLocalHadoopErrorPlatformTest.testLocalErrorReportingInReducer(CascadingStatsLocalHadoopErrorPlatformTest.java:124)] operator Every failed executing operation: TestFailAggregator[decl:'count']
at cascading.flow.stream.AggregatorEveryStage.receive(AggregatorEveryStage.java:136)
at cascading.flow.stream.AggregatorEveryStage.receive(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:49)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
Caused by: java.lang.RuntimeException: failed
at cascading.TestFailAggregator.aggregate(TestFailAggregator.java:54)
at cascading.flow.stream.AggregatorEveryStage.receive(AggregatorEveryStage.java:128)
... 8 more
2014-08-22 19:39:49,150 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [reducer fail test] hadoop job job_local1297184606_0001 state at FAILED
2014-08-22 19:39:49,150 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [reducer fail test] failure info: NA
2014-08-22 19:39:49,153 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [reducer fail test] task completion events identify failed tasks
2014-08-22 19:39:49,153 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [reducer fail test] task completion events count: 0
2014-08-22 19:39:49,173 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [reducer fail test] stopping all jobs
2014-08-22 19:39:49,174 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [reducer fail test] stopping: (1/1) ...errorplatform/reducerfail
2014-08-22 19:39:49,174 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [reducer fail test] stopped all jobs
2014-08-22 19:39:49,176 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.2.x/build/test/output/hadoop2-mr1/cascadingstatslocalhadooperrorplatform/reducerfail/_temporary
2014-08-22 19:39:49,176 WARN cascade.Cascade (Cascade.java:logWarn(1001)) - [reducer fail test] flow failed: reducer fail test
cascading.flow.FlowException: local step failed
at cascading.flow.planner.FlowStepJob.blockOnJob(FlowStepJob.java:219)
at cascading.flow.planner.FlowStepJob.start(FlowStepJob.java:149)
at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:124)
at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:43)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
Caused by: cascading.pipe.OperatorException: [failing reducer][cascading.stats.hadoop.CascadingStatsLocalHadoopErrorPlatformTest.testLocalErrorReportingInReducer(CascadingStatsLocalHadoopErrorPlatformTest.java:124)] operator Every failed executing operation: TestFailAggregator[decl:'count']
at cascading.flow.stream.AggregatorEveryStage.receive(AggregatorEveryStage.java:136)
at cascading.flow.stream.AggregatorEveryStage.receive(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:49)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:462)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:445)
Caused by: java.lang.RuntimeException: failed
at cascading.TestFailAggregator.aggregate(TestFailAggregator.java:54)
at cascading.flow.stream.AggregatorEveryStage.receive(AggregatorEveryStage.java:128)
... 8 more
2014-08-22 19:39:49,178 INFO cascade.Cascade (Cascade.java:logInfo(991)) - [reducer fail test] stopping all flows
2014-08-22 19:39:49,178 INFO cascade.Cascade (Cascade.java:logInfo(991)) - [reducer fail test] stopping flow: reducer fail test
2014-08-22 19:39:49,178 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [reducer fail test] stopping all jobs
2014-08-22 19:39:49,178 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [reducer fail test] stopping: (1/1) ...errorplatform/reducerfail
2014-08-22 19:39:49,179 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [reducer fail test] stopped all jobs
2014-08-22 19:39:49,179 INFO cascade.Cascade (Cascade.java:logInfo(991)) - [reducer fail test] stopped all flows
2014-08-22 19:39:49,202 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2014-08-22 19:39:49,203 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.6/31997f144a2e73eebf04d45ed31402ee30118b2/cascading-hadoop2-mr1-2.5.6.jar
2014-08-22 19:39:49,213 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-08-22 19:39:49,218 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-22 19:39:49,219 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-08-22 19:39:49,232 INFO cascade.Cascade (Cascade.java:logInfo(991)) - [mapper fail test] starting
2014-08-22 19:39:49,233 INFO cascade.Cascade (Cascade.java:logInfo(991)) - [mapper fail test] parallel execution is enabled: true
2014-08-22 19:39:49,234 INFO cascade.Cascade (Cascade.java:logInfo(991)) - [mapper fail test] starting flows: 1
2014-08-22 19:39:49,234 INFO cascade.Cascade (Cascade.java:logInfo(991)) - [mapper fail test] allocating threads: 1
2014-08-22 19:39:49,234 INFO cascade.Cascade (Cascade.java:logInfo(991)) - [mapper fail test] starting flow: mapper fail test
2014-08-22 19:39:49,235 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [mapper fail test] at least one sink is marked for delete
2014-08-22 19:39:49,235 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [mapper fail test] sink oldest modified date: Wed Dec 31 23:59:59 UTC 1969
2014-08-22 19:39:49,238 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [mapper fail test] starting
2014-08-22 19:39:49,238 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [mapper fail test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.2.x/build/classes/test/data/apache.10.txt"]
2014-08-22 19:39:49,238 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [mapper fail test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.2.x/build/test/output/hadoop2-mr1/cascadingstatslocalhadooperrorplatform/mapperfail"]
2014-08-22 19:39:49,239 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [mapper fail test] parallel execution is enabled: false
2014-08-22 19:39:49,240 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [mapper fail test] starting jobs: 1
2014-08-22 19:39:49,241 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [mapper fail test] allocating threads: 1
2014-08-22 19:39:49,242 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [mapper fail test] starting step: (1/1) ...perrorplatform/mapperfail
2014-08-22 19:39:49,244 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 19:39:49,247 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-22 19:39:49,278 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2014-08-22 19:39:49,280 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-08-22 19:39:49,305 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2014-08-22 19:39:49,331 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2014-08-22 19:39:49,332 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2014-08-22 19:39:49,333 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2014-08-22 19:39:49,333 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2014-08-22 19:39:49,334 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2014-08-22 19:39:49,335 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2014-08-22 19:39:49,335 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2014-08-22 19:39:49,336 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2014-08-22 19:39:49,336 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2014-08-22 19:39:49,337 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2014-08-22 19:39:49,359 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_local1919931263_0002
2014-08-22 19:39:49,383 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.2.x/build/test/tmp/mapred/staging/teamcity1919931263/.staging/job_local1919931263_0002/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2014-08-22 19:39:49,383 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.2.x/build/test/tmp/mapred/staging/teamcity1919931263/.staging/job_local1919931263_0002/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2014-08-22 19:39:49,457 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1919931263_0002/job_local1919931263_0002.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2014-08-22 19:39:49,458 WARN conf.Configuration (Configuration.java:loadProperty(2172)) - file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.2.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1919931263_0002/job_local1919931263_0002.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2014-08-22 19:39:49,461 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://localhost:8080/
2014-08-22 19:39:49,462 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(323)) - OutputCommitter set in config null
2014-08-22 19:39:49,463 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(341)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-08-22 19:39:49,462 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [mapper fail test] submitted hadoop job: job_local1919931263_0002
2014-08-22 19:39:49,464 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [mapper fail test] tracking url: http://localhost:8080/
2014-08-22 19:39:49,470 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(389)) - Waiting for map tasks
2014-08-22 19:39:49,470 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(216)) - Starting task: attempt_local1919931263_0002_m_000000_0
2014-08-22 19:39:49,473 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2014-08-22 19:39:49,476 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.2.x/build/classes/test/data/apache.10.txt
2014-08-22 19:39:49,476 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(461)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@44449afc
2014-08-22 19:39:49,479 INFO mapred.MapTask (MapTask.java:runOldMapper(415)) - numReduceTasks: 0
2014-08-22 19:39:49,492 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.5.6
2014-08-22 19:39:49,493 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2014-08-22 19:39:49,502 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.2.x/build/classes/test/data/apache.10.txt"]
2014-08-22 19:39:49,503 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.2.x/build/test/output/hadoop2-mr1/cascadingstatslocalhadooperrorplatform/mapperfail"]
2014-08-22 19:39:49,505 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.CascadingException: testing
at cascading.stats.hadoop.CascadingStatsLocalHadoopErrorPlatformTest$FailFunction.operate(CascadingStatsLocalHadoopErrorPlatformTest.java:81)
at cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:99)
at cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:39)
at cascading.flow.stream.SourceStage.map(SourceStage.java:102)
at cascading.flow.stream.SourceStage.run(SourceStage.java:58)
at cascading.flow.hadoop.FlowMapper.run(FlowMapper.java:130)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:429)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:235)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2014-08-22 19:39:49,512 ERROR stream.SourceStage (SourceStage.java:map(110)) - caught throwable
cascading.CascadingException: testing
at cascading.stats.hadoop.CascadingStatsLocalHadoopErrorPlatformTest$FailFunction.operate(CascadingStatsLocalHadoopErrorPlatformTest.java:81)
at cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:99)
at cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:39)
at cascading.flow.stream.SourceStage.map(SourceStage.java:102)
at cascading.flow.stream.SourceStage.run(SourceStage.java:58)
at cascading.flow.hadoop.FlowMapper.run(FlowMapper.java:130)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:429)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:235)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2014-08-22 19:39:49,514 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(397)) - Map task executor complete.
2014-08-22 19:39:49,516 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(482)) - job_local1919931263_0002
java.lang.Exception: cascading.CascadingException: testing
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:403)
Caused by: cascading.CascadingException: testing
at cascading.stats.hadoop.CascadingStatsLocalHadoopErrorPlatformTest$FailFunction.operate(CascadingStatsLocalHadoopErrorPlatformTest.java:81)
at cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:99)
at cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:39)
at cascading.flow.stream.SourceStage.map(SourceStage.java:102)
at cascading.flow.stream.SourceStage.run(SourceStage.java:58)
at cascading.flow.hadoop.FlowMapper.run(FlowMapper.java:130)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:429)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:235)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2014-08-22 19:39:50,571 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(513)) - reduce > reduce
2014-08-22 19:39:54,465 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [mapper fail test] hadoop job job_local1919931263_0002 state at FAILED
2014-08-22 19:39:54,466 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [mapper fail test] failure info: NA
2014-08-22 19:39:54,466 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [mapper fail test] task completion events identify failed tasks
2014-08-22 19:39:54,466 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [mapper fail test] task completion events count: 0
2014-08-22 19:39:54,467 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [mapper fail test] stopping all jobs
2014-08-22 19:39:54,468 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [mapper fail test] stopping: (1/1) ...perrorplatform/mapperfail
2014-08-22 19:39:54,468 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [mapper fail test] stopped all jobs
2014-08-22 19:39:54,469 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/3945655b04626318/apache-2.2.x/build/test/output/hadoop2-mr1/cascadingstatslocalhadooperrorplatform/mapperfail/_temporary
2014-08-22 19:39:54,469 WARN cascade.Cascade (Cascade.java:logWarn(1001)) - [mapper fail test] flow failed: mapper fail test
cascading.flow.FlowException: local step failed
at cascading.flow.planner.FlowStepJob.blockOnJob(FlowStepJob.java:219)
at cascading.flow.planner.FlowStepJob.start(FlowStepJob.java:149)
at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:124)
at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:43)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
Caused by: cascading.CascadingException: testing
at cascading.stats.hadoop.CascadingStatsLocalHadoopErrorPlatformTest$FailFunction.operate(CascadingStatsLocalHadoopErrorPlatformTest.java:81)
at cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:99)
at cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:39)
at cascading.flow.stream.SourceStage.map(SourceStage.java:102)
at cascading.flow.stream.SourceStage.run(SourceStage.java:58)
at cascading.flow.hadoop.FlowMapper.run(FlowMapper.java:130)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:429)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:235)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
... 5 more
2014-08-22 19:39:54,470 INFO cascade.Cascade (Cascade.java:logInfo(991)) - [mapper fail test] stopping all flows
2014-08-22 19:39:54,471 INFO cascade.Cascade (Cascade.java:logInfo(991)) - [mapper fail test] stopping flow: mapper fail test
2014-08-22 19:39:54,471 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [mapper fail test] stopping all jobs
2014-08-22 19:39:54,471 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [mapper fail test] stopping: (1/1) ...perrorplatform/mapperfail
2014-08-22 19:39:54,471 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [mapper fail test] stopped all jobs
2014-08-22 19:39:54,471 INFO cascade.Cascade (Cascade.java:logInfo(991)) - [mapper fail test] stopped all flows