Class cascading.detail.EveryPipeAssemblyPlatformTest

72

tests

0

failures

24.274s

duration

100%

successful

Tests

Test Duration Result
-1_'field'_'field'[hadoop2-mr1] 0.733s passed
-1_'field'_-1[hadoop2-mr1] 2.843s passed
-1_'field'_ALL[hadoop2-mr1] 0.603s passed
-1_'field'_REPLACE[hadoop2-mr1] 0.030s passed
-1_'field'_RESULTS[hadoop2-mr1] 0.678s passed
-1_'field'_SWAP[hadoop2-mr1] 0.857s passed
-1_ARGS_'field'[hadoop2-mr1] 0.025s passed
-1_ARGS_-1[hadoop2-mr1] 0.490s passed
-1_ARGS_ALL[hadoop2-mr1] 0.022s passed
-1_ARGS_REPLACE[hadoop2-mr1] 0.472s passed
-1_ARGS_RESULTS[hadoop2-mr1] 0.499s passed
-1_ARGS_SWAP[hadoop2-mr1] 0.380s passed
-1_UNKNOWN_'field'[hadoop2-mr1] 0.031s passed
-1_UNKNOWN_-1[hadoop2-mr1] 0.455s passed
-1_UNKNOWN_ALL[hadoop2-mr1] 0.522s passed
-1_UNKNOWN_REPLACE[hadoop2-mr1] 0.475s passed
-1_UNKNOWN_RESULTS[hadoop2-mr1] 0.536s passed
-1_UNKNOWN_SWAP[hadoop2-mr1] 0.497s passed
-1_VALUES_'field'[hadoop2-mr1] 0.025s passed
-1_VALUES_-1[hadoop2-mr1] 0.615s passed
-1_VALUES_ALL[hadoop2-mr1] 0.422s passed
-1_VALUES_REPLACE[hadoop2-mr1] 0.398s passed
-1_VALUES_RESULTS[hadoop2-mr1] 0.418s passed
-1_VALUES_SWAP[hadoop2-mr1] 0.522s passed
0_'field'_'field'[hadoop2-mr1] 0.376s passed
0_'field'_-1[hadoop2-mr1] 0.409s passed
0_'field'_ALL[hadoop2-mr1] 0.336s passed
0_'field'_REPLACE[hadoop2-mr1] 0.022s passed
0_'field'_RESULTS[hadoop2-mr1] 0.360s passed
0_'field'_SWAP[hadoop2-mr1] 0.342s passed
0_ARGS_'field'[hadoop2-mr1] 0.022s passed
0_ARGS_-1[hadoop2-mr1] 0.329s passed
0_ARGS_ALL[hadoop2-mr1] 0.020s passed
0_ARGS_REPLACE[hadoop2-mr1] 0.317s passed
0_ARGS_RESULTS[hadoop2-mr1] 0.330s passed
0_ARGS_SWAP[hadoop2-mr1] 0.329s passed
0_UNKNOWN_'field'[hadoop2-mr1] 0.021s passed
0_UNKNOWN_-1[hadoop2-mr1] 0.340s passed
0_UNKNOWN_ALL[hadoop2-mr1] 0.340s passed
0_UNKNOWN_REPLACE[hadoop2-mr1] 0.310s passed
0_UNKNOWN_RESULTS[hadoop2-mr1] 0.342s passed
0_UNKNOWN_SWAP[hadoop2-mr1] 0.341s passed
0_VALUES_'field'[hadoop2-mr1] 0.021s passed
0_VALUES_-1[hadoop2-mr1] 0.263s passed
0_VALUES_ALL[hadoop2-mr1] 0.258s passed
0_VALUES_REPLACE[hadoop2-mr1] 0.263s passed
0_VALUES_RESULTS[hadoop2-mr1] 0.249s passed
0_VALUES_SWAP[hadoop2-mr1] 0.247s passed
ALL_'field'_'field'[hadoop2-mr1] 0.331s passed
ALL_'field'_-1[hadoop2-mr1] 0.329s passed
ALL_'field'_ALL[hadoop2-mr1] 0.327s passed
ALL_'field'_REPLACE[hadoop2-mr1] 0.022s passed
ALL_'field'_RESULTS[hadoop2-mr1] 0.330s passed
ALL_'field'_SWAP[hadoop2-mr1] 0.329s passed
ALL_ARGS_'field'[hadoop2-mr1] 0.020s passed
ALL_ARGS_-1[hadoop2-mr1] 0.235s passed
ALL_ARGS_ALL[hadoop2-mr1] 0.020s passed
ALL_ARGS_REPLACE[hadoop2-mr1] 0.245s passed
ALL_ARGS_RESULTS[hadoop2-mr1] 0.246s passed
ALL_ARGS_SWAP[hadoop2-mr1] 0.247s passed
ALL_UNKNOWN_'field'[hadoop2-mr1] 0.021s passed
ALL_UNKNOWN_-1[hadoop2-mr1] 0.353s passed
ALL_UNKNOWN_ALL[hadoop2-mr1] 0.324s passed
ALL_UNKNOWN_REPLACE[hadoop2-mr1] 0.250s passed
ALL_UNKNOWN_RESULTS[hadoop2-mr1] 0.337s passed
ALL_UNKNOWN_SWAP[hadoop2-mr1] 0.306s passed
ALL_VALUES_'field'[hadoop2-mr1] 0.020s passed
ALL_VALUES_-1[hadoop2-mr1] 0.252s passed
ALL_VALUES_ALL[hadoop2-mr1] 0.247s passed
ALL_VALUES_REPLACE[hadoop2-mr1] 0.247s passed
ALL_VALUES_RESULTS[hadoop2-mr1] 0.257s passed
ALL_VALUES_SWAP[hadoop2-mr1] 0.244s passed

Standard output

2015-02-11 00:44:11,812 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(187)) - found 1 test platforms from classpath
2015-02-11 00:44:11,876 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(237)) - installing platform: hadoop2-mr1
2015-02-11 00:44:11,876 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(238)) - running test: cascading.detail.EveryPipeAssemblyPlatformTest
2015-02-11 00:44:11,996 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,014 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,025 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,036 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,047 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,047 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,058 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,069 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,070 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,080 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,091 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,092 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,100 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,102 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,102 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,103 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,104 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,104 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,105 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,112 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,112 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,120 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,121 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,131 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,140 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,150 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,159 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,168 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,176 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,176 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,184 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,192 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,192 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,196 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,200 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,201 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,205 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,206 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,206 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,207 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,208 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,208 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,209 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,212 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,213 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,217 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,217 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,222 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,226 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,230 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,233 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,238 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,242 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,242 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,247 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,252 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,252 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,259 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,266 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,267 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,274 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,274 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,275 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,275 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,275 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,276 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,276 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,277 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,277 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,278 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,278 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,279 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-11 00:44:12,302 INFO  hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(105)) - not using cluster
2015-02-11 00:44:12,969 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2015-02-11 00:44:13,255 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:13,258 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:13,270 INFO  property.AppProps (AppProps.java:getAppID(169)) - using app.id: 77189E31AE0C44F5BA53EC925DF202D6
2015-02-11 00:44:13,353 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:13,388 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:13,392 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:13,506 INFO  util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 2.6.3
2015-02-11 00:44:13,509 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:13,510 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:13,510 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_-1"]
2015-02-11 00:44:13,510 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:13,510 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:13,510 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:13,512 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...blyplatform/-1_'field'_-1
2015-02-11 00:44:13,536 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - session.id is deprecated. Instead, use dfs.metrics.session-id
2015-02-11 00:44:13,537 INFO  jvm.JvmMetrics (JvmMetrics.java:init(76)) - Initializing JVM Metrics with processName=JobTracker, sessionId=
2015-02-11 00:44:13,563 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:13,979 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:14,023 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:14,187 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1249840534_0001
2015-02-11 00:44:14,228 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1249840534/.staging/job_local1249840534_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:14,235 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1249840534/.staging/job_local1249840534_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:14,381 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1249840534_0001/job_local1249840534_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:14,385 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1249840534_0001/job_local1249840534_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:14,391 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:14,392 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:14,395 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1249840534_0001
2015-02-11 00:44:14,395 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:14,396 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:14,439 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:14,442 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1249840534_0001_m_000000_0
2015-02-11 00:44:14,484 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:14,494 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:14,495 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@12d28dfa
2015-02-11 00:44:14,505 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:14,512 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:14,661 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:14,661 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:14,661 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:14,662 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:14,662 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:14,687 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:14,687 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:14,731 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.task.partition is deprecated. Instead, use mapreduce.task.partition
2015-02-11 00:44:14,735 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:14,735 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:14,764 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:14,765 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:14,765 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:14,765 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:14,765 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:14,778 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:14,782 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1249840534_0001_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:14,793 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:14,793 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1249840534_0001_m_000000_0' done.
2015-02-11 00:44:14,793 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1249840534_0001_m_000000_0
2015-02-11 00:44:14,794 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:14,797 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:14,797 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1249840534_0001_r_000000_0
2015-02-11 00:44:14,806 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:14,809 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@19ed13da
2015-02-11 00:44:14,823 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:14,827 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1249840534_0001_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:14,858 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#1 about to shuffle output of map attempt_local1249840534_0001_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:14,863 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1249840534_0001_m_000000_0
2015-02-11 00:44:14,907 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:14,908 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:14,910 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:14,910 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:14,919 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:14,920 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:14,923 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:14,924 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:14,925 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:14,925 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:14,925 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:14,926 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:14,928 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:14,928 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:14,952 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:14,953 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_-1"]
2015-02-11 00:44:14,982 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1249840534_0001_r_000000_0 is done. And is in the process of committing
2015-02-11 00:44:14,984 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:14,984 INFO  mapred.Task (Task.java:commit(1162)) - Task attempt_local1249840534_0001_r_000000_0 is allowed to commit now
2015-02-11 00:44:14,993 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1249840534_0001_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_-1/_temporary/0/task_local1249840534_0001_r_000000
2015-02-11 00:44:14,999 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:14,999 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1249840534_0001_r_000000_0' done.
2015-02-11 00:44:14,999 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1249840534_0001_r_000000_0
2015-02-11 00:44:15,000 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:15,054 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_-1/_temporary
2015-02-11 00:44:15,096 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:15,141 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:15,144 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_'field'_-1
2015-02-11 00:44:15,174 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:15,175 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:15,194 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:15,200 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:15,201 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:15,213 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:15,214 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:15,214 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_'field'"]
2015-02-11 00:44:15,215 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:15,215 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:15,216 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:15,217 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...atform/-1_'field'_'field'
2015-02-11 00:44:15,218 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:15,220 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:15,256 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:15,283 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:15,327 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local2082257102_0002
2015-02-11 00:44:15,354 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity2082257102/.staging/job_local2082257102_0002/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:15,358 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity2082257102/.staging/job_local2082257102_0002/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:15,441 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2082257102_0002/job_local2082257102_0002.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:15,444 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2082257102_0002/job_local2082257102_0002.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:15,445 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:15,445 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local2082257102_0002
2015-02-11 00:44:15,445 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:15,446 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:15,446 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:15,452 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:15,452 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local2082257102_0002_m_000000_0
2015-02-11 00:44:15,455 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:15,457 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:15,457 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@3aeebf17
2015-02-11 00:44:15,459 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:15,459 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:15,621 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:15,621 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:15,621 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:15,621 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:15,621 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:15,623 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:15,623 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:15,634 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:15,635 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:15,639 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:15,639 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:15,640 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:15,640 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:15,640 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:15,646 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:15,650 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local2082257102_0002_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:15,653 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:15,653 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local2082257102_0002_m_000000_0' done.
2015-02-11 00:44:15,653 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local2082257102_0002_m_000000_0
2015-02-11 00:44:15,654 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:15,655 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:15,655 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local2082257102_0002_r_000000_0
2015-02-11 00:44:15,658 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:15,658 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@519549e
2015-02-11 00:44:15,660 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:15,660 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local2082257102_0002_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:15,663 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#2 about to shuffle output of map attempt_local2082257102_0002_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:15,665 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local2082257102_0002_m_000000_0
2015-02-11 00:44:15,666 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:15,666 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:15,668 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:15,668 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:15,673 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:15,673 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:15,676 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:15,677 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:15,677 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:15,677 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:15,678 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:15,679 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:15,679 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:15,680 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:15,691 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:15,692 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_'field'"]
2015-02-11 00:44:15,711 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local2082257102_0002_r_000000_0 is done. And is in the process of committing
2015-02-11 00:44:15,714 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:15,715 INFO  mapred.Task (Task.java:commit(1162)) - Task attempt_local2082257102_0002_r_000000_0 is allowed to commit now
2015-02-11 00:44:15,717 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local2082257102_0002_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_'field'/_temporary/0/task_local2082257102_0002_r_000000
2015-02-11 00:44:15,719 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:15,720 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local2082257102_0002_r_000000_0' done.
2015-02-11 00:44:15,721 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local2082257102_0002_r_000000_0
2015-02-11 00:44:15,721 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:15,758 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_'field'/_temporary
2015-02-11 00:44:15,802 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:15,878 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:15,880 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_'field'_'field'
2015-02-11 00:44:15,908 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:15,908 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:15,925 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:15,930 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:15,931 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:15,939 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:15,940 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:15,940 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_RESULTS"]
2015-02-11 00:44:15,941 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:15,941 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:15,941 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:15,941 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...atform/-1_'field'_RESULTS
2015-02-11 00:44:15,943 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:15,944 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:15,978 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:16,003 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:16,078 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1422692844_0003
2015-02-11 00:44:16,104 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1422692844/.staging/job_local1422692844_0003/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:16,107 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1422692844/.staging/job_local1422692844_0003/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:16,199 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1422692844_0003/job_local1422692844_0003.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:16,201 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1422692844_0003/job_local1422692844_0003.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:16,202 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:16,202 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1422692844_0003
2015-02-11 00:44:16,202 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:16,204 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:16,204 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:16,210 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:16,210 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1422692844_0003_m_000000_0
2015-02-11 00:44:16,214 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:16,217 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:16,217 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@6b064b80
2015-02-11 00:44:16,219 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:16,220 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:16,363 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:16,363 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:16,363 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:16,363 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:16,364 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:16,365 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:16,365 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:16,376 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:16,376 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:16,380 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:16,381 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:16,381 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:16,381 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:16,381 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:16,386 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:16,389 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1422692844_0003_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:16,392 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:16,392 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1422692844_0003_m_000000_0' done.
2015-02-11 00:44:16,392 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1422692844_0003_m_000000_0
2015-02-11 00:44:16,392 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:16,393 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:16,393 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1422692844_0003_r_000000_0
2015-02-11 00:44:16,396 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:16,396 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@7a315068
2015-02-11 00:44:16,397 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:16,398 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1422692844_0003_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:16,400 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#3 about to shuffle output of map attempt_local1422692844_0003_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:16,401 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1422692844_0003_m_000000_0
2015-02-11 00:44:16,401 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:16,402 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:16,403 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:16,404 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:16,406 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:16,407 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:16,411 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:16,411 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:16,411 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:16,411 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:16,412 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:16,413 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:16,413 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:16,414 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:16,423 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:16,423 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_RESULTS"]
2015-02-11 00:44:16,439 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1422692844_0003_r_000000_0 is done. And is in the process of committing
2015-02-11 00:44:16,441 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:16,441 INFO  mapred.Task (Task.java:commit(1162)) - Task attempt_local1422692844_0003_r_000000_0 is allowed to commit now
2015-02-11 00:44:16,442 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1422692844_0003_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_RESULTS/_temporary/0/task_local1422692844_0003_r_000000
2015-02-11 00:44:16,444 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:16,444 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1422692844_0003_r_000000_0' done.
2015-02-11 00:44:16,444 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1422692844_0003_r_000000_0
2015-02-11 00:44:16,445 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:16,476 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_RESULTS/_temporary
2015-02-11 00:44:16,513 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:16,557 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:16,559 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_'field'_RESULTS
2015-02-11 00:44:16,581 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:16,582 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:16,593 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:16,601 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:16,601 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:16,610 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:16,610 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:16,610 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_ALL"]
2015-02-11 00:44:16,611 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:16,611 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:16,611 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:16,612 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...lyplatform/-1_'field'_ALL
2015-02-11 00:44:16,613 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:16,614 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:16,647 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:16,670 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:16,693 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local487256378_0004
2015-02-11 00:44:16,719 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity487256378/.staging/job_local487256378_0004/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:16,720 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity487256378/.staging/job_local487256378_0004/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:16,797 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local487256378_0004/job_local487256378_0004.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:16,799 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local487256378_0004/job_local487256378_0004.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:16,800 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:16,800 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local487256378_0004
2015-02-11 00:44:16,801 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:16,801 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:16,801 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:16,806 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:16,806 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local487256378_0004_m_000000_0
2015-02-11 00:44:16,808 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:16,811 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:16,811 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@3b2ab74f
2015-02-11 00:44:16,812 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:16,813 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:16,963 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:16,963 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:16,963 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:16,963 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:16,964 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:16,965 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:16,965 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:16,990 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:16,991 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:16,996 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:16,996 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:16,996 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:16,997 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:16,997 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:17,002 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:17,004 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local487256378_0004_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:17,007 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:17,007 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local487256378_0004_m_000000_0' done.
2015-02-11 00:44:17,007 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local487256378_0004_m_000000_0
2015-02-11 00:44:17,007 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:17,008 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:17,008 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local487256378_0004_r_000000_0
2015-02-11 00:44:17,011 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:17,011 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@7336193e
2015-02-11 00:44:17,012 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:17,013 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local487256378_0004_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:17,016 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#4 about to shuffle output of map attempt_local487256378_0004_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:17,016 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local487256378_0004_m_000000_0
2015-02-11 00:44:17,016 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:17,017 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:17,018 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:17,019 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:17,021 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:17,022 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:17,024 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:17,025 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:17,025 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:17,025 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:17,025 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:17,026 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:17,027 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:17,027 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:17,036 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:17,036 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_ALL"]
2015-02-11 00:44:17,053 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local487256378_0004_r_000000_0 is done. And is in the process of committing
2015-02-11 00:44:17,055 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:17,055 INFO  mapred.Task (Task.java:commit(1162)) - Task attempt_local487256378_0004_r_000000_0 is allowed to commit now
2015-02-11 00:44:17,056 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local487256378_0004_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_ALL/_temporary/0/task_local487256378_0004_r_000000
2015-02-11 00:44:17,058 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:17,058 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local487256378_0004_r_000000_0' done.
2015-02-11 00:44:17,058 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local487256378_0004_r_000000_0
2015-02-11 00:44:17,058 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:17,089 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_ALL/_temporary
2015-02-11 00:44:17,123 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:17,161 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:17,163 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_'field'_ALL
2015-02-11 00:44:17,185 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:17,185 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:17,196 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_'field'_REPLACE
2015-02-11 00:44:17,215 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:17,216 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:17,227 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:17,231 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:17,232 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:17,239 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:17,241 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:17,242 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_SWAP"]
2015-02-11 00:44:17,243 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:17,243 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:17,243 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:17,244 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...yplatform/-1_'field'_SWAP
2015-02-11 00:44:17,245 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:17,247 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:17,278 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:17,300 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:17,319 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1198734807_0005
2015-02-11 00:44:17,339 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1198734807/.staging/job_local1198734807_0005/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:17,340 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1198734807/.staging/job_local1198734807_0005/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:17,397 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1198734807_0005/job_local1198734807_0005.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:17,398 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1198734807_0005/job_local1198734807_0005.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:17,399 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:17,399 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1198734807_0005
2015-02-11 00:44:17,399 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:17,400 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:17,400 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:17,404 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:17,404 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1198734807_0005_m_000000_0
2015-02-11 00:44:17,406 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:17,408 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:17,408 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@82f60ce
2015-02-11 00:44:17,410 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:17,410 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:17,563 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:17,563 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:17,563 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:17,564 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:17,564 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:17,566 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:17,566 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:17,575 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:17,576 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:17,580 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:17,580 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:17,580 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:17,580 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:17,580 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:17,585 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:17,588 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1198734807_0005_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:17,590 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:17,590 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1198734807_0005_m_000000_0' done.
2015-02-11 00:44:17,591 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1198734807_0005_m_000000_0
2015-02-11 00:44:17,591 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:17,591 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:17,592 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1198734807_0005_r_000000_0
2015-02-11 00:44:17,596 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:17,596 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@5426807f
2015-02-11 00:44:17,597 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:17,598 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1198734807_0005_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:17,600 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#5 about to shuffle output of map attempt_local1198734807_0005_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:17,600 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1198734807_0005_m_000000_0
2015-02-11 00:44:17,600 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:17,602 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:17,603 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:17,603 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:17,910 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:17,910 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:17,913 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:17,913 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:17,913 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:17,914 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:17,914 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:17,916 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:17,916 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:17,917 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:17,926 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:17,926 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_SWAP"]
2015-02-11 00:44:17,942 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1198734807_0005_r_000000_0 is done. And is in the process of committing
2015-02-11 00:44:17,944 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:17,944 INFO  mapred.Task (Task.java:commit(1162)) - Task attempt_local1198734807_0005_r_000000_0 is allowed to commit now
2015-02-11 00:44:17,945 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1198734807_0005_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_SWAP/_temporary/0/task_local1198734807_0005_r_000000
2015-02-11 00:44:17,947 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:17,947 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1198734807_0005_r_000000_0' done.
2015-02-11 00:44:17,947 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1198734807_0005_r_000000_0
2015-02-11 00:44:17,947 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:17,966 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_SWAP/_temporary
2015-02-11 00:44:18,000 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:18,051 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:18,052 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_'field'_SWAP
2015-02-11 00:44:18,071 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:18,072 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:18,083 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:18,087 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:18,087 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:18,095 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:18,095 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:18,095 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_-1"]
2015-02-11 00:44:18,096 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:18,096 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:18,096 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:18,096 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...blyplatform/-1_UNKNOWN_-1
2015-02-11 00:44:18,097 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:18,098 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:18,128 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:18,151 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:18,171 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local174214700_0006
2015-02-11 00:44:18,190 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity174214700/.staging/job_local174214700_0006/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:18,191 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity174214700/.staging/job_local174214700_0006/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:18,248 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local174214700_0006/job_local174214700_0006.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:18,249 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local174214700_0006/job_local174214700_0006.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:18,250 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:18,250 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local174214700_0006
2015-02-11 00:44:18,250 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:18,251 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:18,250 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:18,254 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:18,254 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local174214700_0006_m_000000_0
2015-02-11 00:44:18,257 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:18,259 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:18,259 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@3956f14c
2015-02-11 00:44:18,261 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:18,261 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:18,333 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:18,333 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:18,333 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:18,333 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:18,334 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:18,336 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:18,337 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:18,345 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:18,346 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:18,350 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:18,351 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:18,351 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:18,352 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:18,352 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:18,357 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:18,360 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local174214700_0006_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:18,363 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:18,363 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local174214700_0006_m_000000_0' done.
2015-02-11 00:44:18,363 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local174214700_0006_m_000000_0
2015-02-11 00:44:18,364 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:18,365 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:18,365 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local174214700_0006_r_000000_0
2015-02-11 00:44:18,367 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:18,367 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@561279c8
2015-02-11 00:44:18,368 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:18,369 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local174214700_0006_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:18,371 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#6 about to shuffle output of map attempt_local174214700_0006_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:18,371 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local174214700_0006_m_000000_0
2015-02-11 00:44:18,372 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:18,372 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:18,373 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:18,374 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:18,379 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:18,380 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:18,382 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:18,382 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:18,383 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:18,383 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:18,384 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:18,385 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:18,385 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:18,385 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:18,394 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:18,394 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_-1"]
2015-02-11 00:44:18,409 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local174214700_0006_r_000000_0 is done. And is in the process of committing
2015-02-11 00:44:18,411 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:18,411 INFO  mapred.Task (Task.java:commit(1162)) - Task attempt_local174214700_0006_r_000000_0 is allowed to commit now
2015-02-11 00:44:18,412 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local174214700_0006_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_-1/_temporary/0/task_local174214700_0006_r_000000
2015-02-11 00:44:18,413 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:18,413 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local174214700_0006_r_000000_0' done.
2015-02-11 00:44:18,414 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local174214700_0006_r_000000_0
2015-02-11 00:44:18,414 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:18,433 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_-1/_temporary
2015-02-11 00:44:18,467 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:18,506 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:18,508 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_-1
2015-02-11 00:44:18,529 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:18,529 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:18,539 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_'field'
2015-02-11 00:44:18,560 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:18,561 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:18,571 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:18,574 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:18,575 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:18,581 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:18,582 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:18,582 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_RESULTS"]
2015-02-11 00:44:18,582 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:18,582 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:18,582 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:18,583 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...atform/-1_UNKNOWN_RESULTS
2015-02-11 00:44:18,584 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:18,587 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:18,618 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:18,641 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:18,660 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local666412153_0007
2015-02-11 00:44:18,682 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity666412153/.staging/job_local666412153_0007/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:18,683 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity666412153/.staging/job_local666412153_0007/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:18,746 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local666412153_0007/job_local666412153_0007.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:18,747 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local666412153_0007/job_local666412153_0007.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:18,748 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:18,749 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local666412153_0007
2015-02-11 00:44:18,749 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:18,750 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:18,750 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:18,754 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:18,754 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local666412153_0007_m_000000_0
2015-02-11 00:44:18,756 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:18,758 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:18,758 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@2cdf88d2
2015-02-11 00:44:18,760 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:18,760 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:18,904 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:18,904 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:18,904 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:18,904 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:18,904 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:18,906 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:18,906 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:18,914 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:18,915 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:18,919 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:18,919 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:18,919 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:18,919 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:18,919 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:18,924 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:18,926 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local666412153_0007_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:18,929 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:18,929 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local666412153_0007_m_000000_0' done.
2015-02-11 00:44:18,929 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local666412153_0007_m_000000_0
2015-02-11 00:44:18,930 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:18,931 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:18,931 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local666412153_0007_r_000000_0
2015-02-11 00:44:18,933 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:18,934 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@5358aac4
2015-02-11 00:44:18,934 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:18,935 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local666412153_0007_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:18,937 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#7 about to shuffle output of map attempt_local666412153_0007_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:18,938 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local666412153_0007_m_000000_0
2015-02-11 00:44:18,938 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:18,939 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:18,940 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:18,940 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:18,944 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:18,944 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:18,946 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:18,947 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:18,947 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:18,947 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:18,947 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:18,948 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:18,949 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:18,949 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:18,957 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:18,957 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_RESULTS"]
2015-02-11 00:44:18,973 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local666412153_0007_r_000000_0 is done. And is in the process of committing
2015-02-11 00:44:18,975 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:18,975 INFO  mapred.Task (Task.java:commit(1162)) - Task attempt_local666412153_0007_r_000000_0 is allowed to commit now
2015-02-11 00:44:18,976 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local666412153_0007_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_RESULTS/_temporary/0/task_local666412153_0007_r_000000
2015-02-11 00:44:18,978 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:18,978 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local666412153_0007_r_000000_0' done.
2015-02-11 00:44:18,978 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local666412153_0007_r_000000_0
2015-02-11 00:44:18,979 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:19,002 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_RESULTS/_temporary
2015-02-11 00:44:19,036 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:19,074 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:19,076 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_RESULTS
2015-02-11 00:44:19,100 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:19,100 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:19,114 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:19,118 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:19,118 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:19,126 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:19,127 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:19,127 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_ALL"]
2015-02-11 00:44:19,127 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:19,127 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:19,127 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:19,128 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...lyplatform/-1_UNKNOWN_ALL
2015-02-11 00:44:19,129 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:19,131 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:19,159 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:19,190 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:19,209 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local494124739_0008
2015-02-11 00:44:19,231 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity494124739/.staging/job_local494124739_0008/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:19,232 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity494124739/.staging/job_local494124739_0008/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:19,288 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local494124739_0008/job_local494124739_0008.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:19,289 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local494124739_0008/job_local494124739_0008.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:19,290 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:19,290 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local494124739_0008
2015-02-11 00:44:19,290 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:19,290 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:19,291 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:19,294 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:19,294 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local494124739_0008_m_000000_0
2015-02-11 00:44:19,296 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:19,298 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:19,298 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@37670cc6
2015-02-11 00:44:19,300 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:19,300 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:19,442 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:19,443 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:19,443 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:19,443 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:19,443 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:19,444 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:19,444 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:19,453 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:19,453 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:19,457 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:19,457 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:19,457 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:19,457 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:19,457 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:19,462 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:19,464 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local494124739_0008_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:19,466 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:19,467 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local494124739_0008_m_000000_0' done.
2015-02-11 00:44:19,467 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local494124739_0008_m_000000_0
2015-02-11 00:44:19,467 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:19,468 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:19,468 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local494124739_0008_r_000000_0
2015-02-11 00:44:19,470 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:19,470 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@7bc5b828
2015-02-11 00:44:19,471 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:19,472 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local494124739_0008_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:19,474 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#8 about to shuffle output of map attempt_local494124739_0008_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:19,474 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local494124739_0008_m_000000_0
2015-02-11 00:44:19,475 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:19,475 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:19,476 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:19,477 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:19,479 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:19,479 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:19,481 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:19,482 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:19,482 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:19,482 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:19,482 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:19,483 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:19,484 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:19,484 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:19,491 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:19,491 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_ALL"]
2015-02-11 00:44:19,506 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local494124739_0008_r_000000_0 is done. And is in the process of committing
2015-02-11 00:44:19,508 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:19,508 INFO  mapred.Task (Task.java:commit(1162)) - Task attempt_local494124739_0008_r_000000_0 is allowed to commit now
2015-02-11 00:44:19,509 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local494124739_0008_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_ALL/_temporary/0/task_local494124739_0008_r_000000
2015-02-11 00:44:19,510 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:19,511 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local494124739_0008_r_000000_0' done.
2015-02-11 00:44:19,511 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local494124739_0008_r_000000_0
2015-02-11 00:44:19,511 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:19,531 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_ALL/_temporary
2015-02-11 00:44:19,564 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:19,597 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:19,599 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_ALL
2015-02-11 00:44:19,617 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:19,618 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:19,628 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:19,631 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:19,632 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:19,639 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:19,640 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:19,640 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_REPLACE"]
2015-02-11 00:44:19,640 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:19,640 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:19,640 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:19,641 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...atform/-1_UNKNOWN_REPLACE
2015-02-11 00:44:19,642 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:19,643 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:19,670 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:19,693 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:19,714 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local336854051_0009
2015-02-11 00:44:19,735 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity336854051/.staging/job_local336854051_0009/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:19,736 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity336854051/.staging/job_local336854051_0009/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:19,804 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local336854051_0009/job_local336854051_0009.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:19,806 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local336854051_0009/job_local336854051_0009.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:19,807 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:19,808 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local336854051_0009
2015-02-11 00:44:19,808 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:19,808 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:19,810 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:19,814 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:19,814 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local336854051_0009_m_000000_0
2015-02-11 00:44:19,818 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:19,821 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:19,821 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@2a11890d
2015-02-11 00:44:19,824 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:19,824 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:19,982 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:19,983 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:19,983 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:19,983 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:19,983 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:19,985 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:19,985 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:19,993 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:19,993 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:19,997 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:19,998 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:19,998 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:19,998 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:19,998 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:20,003 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:20,006 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local336854051_0009_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:20,008 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:20,009 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local336854051_0009_m_000000_0' done.
2015-02-11 00:44:20,009 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local336854051_0009_m_000000_0
2015-02-11 00:44:20,009 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:20,010 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:20,010 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local336854051_0009_r_000000_0
2015-02-11 00:44:20,012 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:20,012 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@53281264
2015-02-11 00:44:20,013 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:20,014 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local336854051_0009_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:20,016 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#9 about to shuffle output of map attempt_local336854051_0009_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:20,017 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local336854051_0009_m_000000_0
2015-02-11 00:44:20,017 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:20,017 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:20,019 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:20,019 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:20,021 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:20,021 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:20,026 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:20,026 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:20,027 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:20,027 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:20,027 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:20,028 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:20,029 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:20,029 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:20,037 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:20,038 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_REPLACE"]
2015-02-11 00:44:20,050 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-11 00:44:20,053 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:20,056 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local336854051_0009
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-11 00:44:20,063 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local336854051_0009 state at FAILED
2015-02-11 00:44:20,063 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-11 00:44:20,064 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-11 00:44:20,064 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-11 00:44:20,071 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-11 00:44:20,072 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...atform/-1_UNKNOWN_REPLACE
2015-02-11 00:44:20,073 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-11 00:44:20,073 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_REPLACE/_temporary
2015-02-11 00:44:20,073 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_REPLACE
2015-02-11 00:44:20,104 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:20,105 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:20,113 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:20,116 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:20,117 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:20,122 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:20,123 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:20,123 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_SWAP"]
2015-02-11 00:44:20,123 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:20,123 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:20,123 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:20,124 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...yplatform/-1_UNKNOWN_SWAP
2015-02-11 00:44:20,125 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:20,126 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:20,153 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:20,173 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:20,190 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1246077705_0010
2015-02-11 00:44:20,209 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1246077705/.staging/job_local1246077705_0010/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:20,210 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1246077705/.staging/job_local1246077705_0010/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:20,263 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1246077705_0010/job_local1246077705_0010.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:20,264 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1246077705_0010/job_local1246077705_0010.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:20,264 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:20,265 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1246077705_0010
2015-02-11 00:44:20,265 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:20,265 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:20,265 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:20,268 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:20,269 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1246077705_0010_m_000000_0
2015-02-11 00:44:20,270 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:20,272 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:20,272 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@6479b43f
2015-02-11 00:44:20,274 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:20,274 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:20,422 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:20,423 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:20,423 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:20,423 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:20,423 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:20,424 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:20,424 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:20,432 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:20,432 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:20,436 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:20,436 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:20,436 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:20,436 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:20,436 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:20,440 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:20,443 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1246077705_0010_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:20,445 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:20,445 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1246077705_0010_m_000000_0' done.
2015-02-11 00:44:20,445 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1246077705_0010_m_000000_0
2015-02-11 00:44:20,445 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:20,446 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:20,446 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1246077705_0010_r_000000_0
2015-02-11 00:44:20,448 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:20,448 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@5651e202
2015-02-11 00:44:20,449 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:20,450 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1246077705_0010_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:20,452 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#10 about to shuffle output of map attempt_local1246077705_0010_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:20,453 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1246077705_0010_m_000000_0
2015-02-11 00:44:20,453 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:20,453 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:20,455 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:20,455 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:20,457 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:20,457 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:20,459 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:20,460 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:20,460 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:20,460 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:20,460 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:20,461 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:20,461 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:20,462 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:20,469 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:20,469 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_SWAP"]
2015-02-11 00:44:20,484 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1246077705_0010_r_000000_0 is done. And is in the process of committing
2015-02-11 00:44:20,486 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:20,486 INFO  mapred.Task (Task.java:commit(1162)) - Task attempt_local1246077705_0010_r_000000_0 is allowed to commit now
2015-02-11 00:44:20,487 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1246077705_0010_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_SWAP/_temporary/0/task_local1246077705_0010_r_000000
2015-02-11 00:44:20,488 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:20,489 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1246077705_0010_r_000000_0' done.
2015-02-11 00:44:20,489 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1246077705_0010_r_000000_0
2015-02-11 00:44:20,489 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:20,506 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_SWAP/_temporary
2015-02-11 00:44:20,537 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:20,569 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:20,571 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_SWAP
2015-02-11 00:44:20,589 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:20,589 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:20,598 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:20,600 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:20,600 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:20,606 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:20,606 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:20,607 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_-1"]
2015-02-11 00:44:20,607 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:20,607 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:20,607 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:20,608 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...mblyplatform/-1_VALUES_-1
2015-02-11 00:44:20,608 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:20,609 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:20,635 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:20,656 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:20,672 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1664445300_0011
2015-02-11 00:44:20,693 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1664445300/.staging/job_local1664445300_0011/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:20,695 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1664445300/.staging/job_local1664445300_0011/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:20,758 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1664445300_0011/job_local1664445300_0011.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:20,759 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1664445300_0011/job_local1664445300_0011.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:20,760 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:20,761 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1664445300_0011
2015-02-11 00:44:20,761 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:20,761 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:20,761 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:20,765 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:20,765 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1664445300_0011_m_000000_0
2015-02-11 00:44:20,767 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:20,768 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:20,769 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@7bc7956b
2015-02-11 00:44:20,770 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:20,770 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:21,100 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:21,101 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:21,102 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:21,103 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:21,103 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:21,105 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:21,106 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:21,114 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:21,114 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:21,119 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:21,119 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:21,119 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:21,120 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:21,120 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:21,124 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:21,127 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1664445300_0011_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:21,129 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:21,130 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1664445300_0011_m_000000_0' done.
2015-02-11 00:44:21,130 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1664445300_0011_m_000000_0
2015-02-11 00:44:21,130 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:21,131 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:21,131 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1664445300_0011_r_000000_0
2015-02-11 00:44:21,133 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:21,134 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@63ff3510
2015-02-11 00:44:21,134 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:21,135 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1664445300_0011_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:21,137 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#11 about to shuffle output of map attempt_local1664445300_0011_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:21,137 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1664445300_0011_m_000000_0
2015-02-11 00:44:21,138 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:21,138 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:21,140 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:21,140 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:21,144 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:21,144 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:21,146 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:21,146 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:21,147 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:21,147 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:21,147 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:21,148 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:21,148 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:21,148 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:21,155 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:21,155 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_-1"]
2015-02-11 00:44:21,165 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-11 00:44:21,166 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:21,168 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1664445300_0011
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-11 00:44:21,177 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local1664445300_0011 state at FAILED
2015-02-11 00:44:21,177 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-11 00:44:21,177 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-11 00:44:21,177 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-11 00:44:21,184 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-11 00:44:21,184 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...mblyplatform/-1_VALUES_-1
2015-02-11 00:44:21,185 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-11 00:44:21,185 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_-1/_temporary
2015-02-11 00:44:21,185 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_-1
2015-02-11 00:44:21,204 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:21,204 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:21,211 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_'field'
2015-02-11 00:44:21,229 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:21,229 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:21,237 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:21,239 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:21,240 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:21,245 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:21,246 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:21,246 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_RESULTS"]
2015-02-11 00:44:21,246 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:21,246 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:21,246 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:21,247 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...latform/-1_VALUES_RESULTS
2015-02-11 00:44:21,247 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:21,249 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:21,275 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:21,295 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:21,312 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1635489382_0012
2015-02-11 00:44:21,331 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1635489382/.staging/job_local1635489382_0012/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:21,332 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1635489382/.staging/job_local1635489382_0012/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:21,383 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1635489382_0012/job_local1635489382_0012.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:21,385 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1635489382_0012/job_local1635489382_0012.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:21,385 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:21,386 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1635489382_0012
2015-02-11 00:44:21,386 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:21,386 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:21,386 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:21,389 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:21,389 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1635489382_0012_m_000000_0
2015-02-11 00:44:21,391 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:21,393 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:21,393 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@72334bfe
2015-02-11 00:44:21,394 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:21,395 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:21,556 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:21,556 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:21,556 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:21,557 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:21,557 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:21,558 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:21,559 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:21,566 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:21,566 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:21,570 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:21,570 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:21,571 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:21,571 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:21,571 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:21,575 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:21,577 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1635489382_0012_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:21,579 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:21,579 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1635489382_0012_m_000000_0' done.
2015-02-11 00:44:21,580 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1635489382_0012_m_000000_0
2015-02-11 00:44:21,580 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:21,580 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:21,581 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1635489382_0012_r_000000_0
2015-02-11 00:44:21,582 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:21,583 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@509c6c30
2015-02-11 00:44:21,583 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:21,584 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1635489382_0012_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:21,586 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#12 about to shuffle output of map attempt_local1635489382_0012_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:21,587 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1635489382_0012_m_000000_0
2015-02-11 00:44:21,587 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:21,588 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:21,588 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:21,589 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:21,594 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:21,594 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:21,596 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:21,597 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:21,597 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:21,597 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:21,597 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:21,598 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:21,599 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:21,599 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:21,606 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:21,606 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_RESULTS"]
2015-02-11 00:44:21,616 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-11 00:44:21,617 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:21,619 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1635489382_0012
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-11 00:44:21,621 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local1635489382_0012 state at FAILED
2015-02-11 00:44:21,621 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-11 00:44:21,621 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-11 00:44:21,621 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-11 00:44:21,628 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-11 00:44:21,629 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...latform/-1_VALUES_RESULTS
2015-02-11 00:44:21,629 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-11 00:44:21,630 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_RESULTS/_temporary
2015-02-11 00:44:21,630 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_RESULTS
2015-02-11 00:44:21,648 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:21,649 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:21,657 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:21,659 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:21,659 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:21,664 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:21,665 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:21,665 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_ALL"]
2015-02-11 00:44:21,665 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:21,666 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:21,666 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:21,667 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...blyplatform/-1_VALUES_ALL
2015-02-11 00:44:21,668 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:21,669 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:21,694 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:21,714 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:21,731 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1409206345_0013
2015-02-11 00:44:21,749 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1409206345/.staging/job_local1409206345_0013/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:21,750 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1409206345/.staging/job_local1409206345_0013/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:21,804 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1409206345_0013/job_local1409206345_0013.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:21,806 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1409206345_0013/job_local1409206345_0013.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:21,806 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:21,807 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1409206345_0013
2015-02-11 00:44:21,807 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:21,807 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:21,807 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:21,815 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:21,815 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1409206345_0013_m_000000_0
2015-02-11 00:44:21,816 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:21,818 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:21,818 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@5b5034e0
2015-02-11 00:44:21,820 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:21,820 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:21,980 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:21,981 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:21,981 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:21,981 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:21,981 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:21,982 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:21,983 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:21,989 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:21,990 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:21,994 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:21,994 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:21,994 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:21,994 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:21,994 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:21,998 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:22,000 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1409206345_0013_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:22,002 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:22,002 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1409206345_0013_m_000000_0' done.
2015-02-11 00:44:22,003 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1409206345_0013_m_000000_0
2015-02-11 00:44:22,003 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:22,003 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:22,004 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1409206345_0013_r_000000_0
2015-02-11 00:44:22,006 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:22,006 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@8191a42
2015-02-11 00:44:22,007 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:22,008 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1409206345_0013_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:22,010 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#13 about to shuffle output of map attempt_local1409206345_0013_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:22,011 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1409206345_0013_m_000000_0
2015-02-11 00:44:22,011 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:22,011 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:22,013 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:22,013 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:22,015 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:22,016 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:22,018 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:22,018 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:22,019 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:22,019 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:22,020 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:22,021 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:22,021 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:22,022 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:22,028 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:22,029 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_ALL"]
2015-02-11 00:44:22,038 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-11 00:44:22,039 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:22,041 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1409206345_0013
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-11 00:44:22,044 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local1409206345_0013 state at FAILED
2015-02-11 00:44:22,044 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-11 00:44:22,044 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-11 00:44:22,044 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-11 00:44:22,051 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-11 00:44:22,051 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...blyplatform/-1_VALUES_ALL
2015-02-11 00:44:22,052 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-11 00:44:22,052 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_ALL/_temporary
2015-02-11 00:44:22,052 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_ALL
2015-02-11 00:44:22,071 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:22,071 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:22,079 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:22,081 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:22,082 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:22,086 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:22,087 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:22,087 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_REPLACE"]
2015-02-11 00:44:22,087 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:22,088 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:22,088 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:22,089 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...latform/-1_VALUES_REPLACE
2015-02-11 00:44:22,089 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:22,090 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:22,116 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:22,135 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:22,152 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local181198779_0014
2015-02-11 00:44:22,171 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity181198779/.staging/job_local181198779_0014/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:22,173 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity181198779/.staging/job_local181198779_0014/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:22,224 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local181198779_0014/job_local181198779_0014.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:22,226 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local181198779_0014/job_local181198779_0014.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:22,226 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:22,226 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local181198779_0014
2015-02-11 00:44:22,227 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:22,227 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:22,227 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:22,230 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:22,230 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local181198779_0014_m_000000_0
2015-02-11 00:44:22,232 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:22,233 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:22,233 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@550df8c7
2015-02-11 00:44:22,235 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:22,235 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:22,384 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:22,385 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:22,385 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:22,385 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:22,385 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:22,386 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:22,386 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:22,393 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:22,393 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:22,397 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:22,397 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:22,398 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:22,398 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:22,398 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:22,401 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:22,403 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local181198779_0014_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:22,405 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:22,405 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local181198779_0014_m_000000_0' done.
2015-02-11 00:44:22,406 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local181198779_0014_m_000000_0
2015-02-11 00:44:22,406 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:22,406 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:22,407 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local181198779_0014_r_000000_0
2015-02-11 00:44:22,408 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:22,409 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@19160e64
2015-02-11 00:44:22,409 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:22,410 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local181198779_0014_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:22,412 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#14 about to shuffle output of map attempt_local181198779_0014_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:22,412 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local181198779_0014_m_000000_0
2015-02-11 00:44:22,413 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:22,413 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:22,414 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:22,414 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:22,416 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:22,417 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:22,419 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:22,419 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:22,419 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:22,419 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:22,420 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:22,420 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:22,421 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:22,421 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:22,427 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:22,427 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_REPLACE"]
2015-02-11 00:44:22,437 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-11 00:44:22,438 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:22,440 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local181198779_0014
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-11 00:44:22,440 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local181198779_0014 state at FAILED
2015-02-11 00:44:22,441 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-11 00:44:22,441 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-11 00:44:22,442 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-11 00:44:22,449 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-11 00:44:22,449 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...latform/-1_VALUES_REPLACE
2015-02-11 00:44:22,451 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-11 00:44:22,451 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_REPLACE/_temporary
2015-02-11 00:44:22,451 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_REPLACE
2015-02-11 00:44:22,469 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:22,470 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:22,478 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:22,480 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:22,480 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:22,484 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:22,485 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:22,485 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_SWAP"]
2015-02-11 00:44:22,486 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:22,486 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:22,487 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:22,488 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...lyplatform/-1_VALUES_SWAP
2015-02-11 00:44:22,489 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:22,490 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:22,515 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:22,534 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:22,551 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1759415395_0015
2015-02-11 00:44:22,568 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1759415395/.staging/job_local1759415395_0015/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:22,569 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1759415395/.staging/job_local1759415395_0015/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:22,619 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1759415395_0015/job_local1759415395_0015.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:22,620 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1759415395_0015/job_local1759415395_0015.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:22,620 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:22,621 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1759415395_0015
2015-02-11 00:44:22,621 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:22,622 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:22,621 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:22,624 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:22,625 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1759415395_0015_m_000000_0
2015-02-11 00:44:22,626 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:22,628 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:22,628 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@54d81cda
2015-02-11 00:44:22,629 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:22,629 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:22,902 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:22,902 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:22,902 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:22,902 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:22,902 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:22,904 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:22,904 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:22,911 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:22,911 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:22,915 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:22,915 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:22,915 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:22,915 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:22,915 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:22,919 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:22,921 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1759415395_0015_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:22,923 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:22,923 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1759415395_0015_m_000000_0' done.
2015-02-11 00:44:22,923 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1759415395_0015_m_000000_0
2015-02-11 00:44:22,924 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:22,925 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:22,925 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1759415395_0015_r_000000_0
2015-02-11 00:44:22,926 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:22,927 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@5052d2c4
2015-02-11 00:44:22,927 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:22,929 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1759415395_0015_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:22,930 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#15 about to shuffle output of map attempt_local1759415395_0015_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:22,931 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1759415395_0015_m_000000_0
2015-02-11 00:44:22,931 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:22,932 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:22,933 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:22,933 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:22,936 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:22,936 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:22,938 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:22,938 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:22,938 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:22,938 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:22,939 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:22,939 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:22,940 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:22,940 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:22,947 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:22,947 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_SWAP"]
2015-02-11 00:44:22,956 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-11 00:44:22,957 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:22,961 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1759415395_0015
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-11 00:44:22,965 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local1759415395_0015 state at FAILED
2015-02-11 00:44:22,965 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-11 00:44:22,966 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-11 00:44:22,966 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-11 00:44:22,971 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-11 00:44:22,972 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...lyplatform/-1_VALUES_SWAP
2015-02-11 00:44:22,972 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-11 00:44:22,973 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_SWAP/_temporary
2015-02-11 00:44:22,973 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_SWAP
2015-02-11 00:44:22,991 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:22,991 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:22,999 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:23,000 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:23,001 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:23,006 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:23,006 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:23,006 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_-1"]
2015-02-11 00:44:23,006 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:23,006 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:23,007 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:23,007 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...semblyplatform/-1_ARGS_-1
2015-02-11 00:44:23,008 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:23,009 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:23,051 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:23,071 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:23,089 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1082115188_0016
2015-02-11 00:44:23,107 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1082115188/.staging/job_local1082115188_0016/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:23,108 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1082115188/.staging/job_local1082115188_0016/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:23,158 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1082115188_0016/job_local1082115188_0016.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:23,160 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1082115188_0016/job_local1082115188_0016.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:23,160 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:23,161 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1082115188_0016
2015-02-11 00:44:23,161 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:23,161 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:23,161 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:23,164 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:23,164 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1082115188_0016_m_000000_0
2015-02-11 00:44:23,165 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:23,168 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:23,168 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@230a4761
2015-02-11 00:44:23,169 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:23,170 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:23,315 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:23,315 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:23,315 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:23,315 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:23,316 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:23,317 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:23,317 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:23,324 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:23,325 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:23,328 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:23,328 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:23,329 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:23,329 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:23,329 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:23,332 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:23,334 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1082115188_0016_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:23,336 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:23,337 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1082115188_0016_m_000000_0' done.
2015-02-11 00:44:23,337 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1082115188_0016_m_000000_0
2015-02-11 00:44:23,337 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:23,338 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:23,338 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1082115188_0016_r_000000_0
2015-02-11 00:44:23,340 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:23,340 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@51fe8884
2015-02-11 00:44:23,341 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:23,342 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1082115188_0016_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:23,343 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#16 about to shuffle output of map attempt_local1082115188_0016_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:23,344 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1082115188_0016_m_000000_0
2015-02-11 00:44:23,344 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:23,345 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:23,346 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:23,346 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:23,349 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:23,350 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:23,351 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:23,352 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:23,352 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:23,352 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:23,352 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:23,353 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:23,354 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:23,354 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:23,360 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:23,361 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_-1"]
2015-02-11 00:44:23,376 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1082115188_0016_r_000000_0 is done. And is in the process of committing
2015-02-11 00:44:23,378 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:23,378 INFO  mapred.Task (Task.java:commit(1162)) - Task attempt_local1082115188_0016_r_000000_0 is allowed to commit now
2015-02-11 00:44:23,379 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1082115188_0016_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_-1/_temporary/0/task_local1082115188_0016_r_000000
2015-02-11 00:44:23,380 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:23,380 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1082115188_0016_r_000000_0' done.
2015-02-11 00:44:23,380 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1082115188_0016_r_000000_0
2015-02-11 00:44:23,381 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:23,401 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_-1/_temporary
2015-02-11 00:44:23,432 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:23,462 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:23,464 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_-1
2015-02-11 00:44:23,483 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:23,483 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:23,490 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_'field'
2015-02-11 00:44:23,509 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:23,509 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:23,517 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:23,519 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:23,520 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:23,525 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:23,526 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:23,526 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_RESULTS"]
2015-02-11 00:44:23,527 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:23,527 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:23,528 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:23,529 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...yplatform/-1_ARGS_RESULTS
2015-02-11 00:44:23,530 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:23,531 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:23,558 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:23,578 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:23,594 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1229273713_0017
2015-02-11 00:44:23,612 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1229273713/.staging/job_local1229273713_0017/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:23,613 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1229273713/.staging/job_local1229273713_0017/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:23,671 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1229273713_0017/job_local1229273713_0017.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:23,673 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1229273713_0017/job_local1229273713_0017.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:23,673 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:23,674 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1229273713_0017
2015-02-11 00:44:23,674 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:23,675 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:23,675 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:23,678 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:23,679 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1229273713_0017_m_000000_0
2015-02-11 00:44:23,680 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:23,682 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:23,683 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@72b6507e
2015-02-11 00:44:23,684 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:23,684 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:23,829 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:23,830 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:23,830 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:23,830 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:23,830 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:23,832 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:23,832 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:23,839 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:23,839 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:23,843 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:23,843 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:23,844 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:23,844 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:23,844 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:23,848 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:23,850 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1229273713_0017_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:23,852 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:23,852 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1229273713_0017_m_000000_0' done.
2015-02-11 00:44:23,852 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1229273713_0017_m_000000_0
2015-02-11 00:44:23,853 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:23,853 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:23,854 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1229273713_0017_r_000000_0
2015-02-11 00:44:23,856 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:23,856 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@52e16021
2015-02-11 00:44:23,858 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:23,859 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1229273713_0017_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:23,860 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#17 about to shuffle output of map attempt_local1229273713_0017_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:23,861 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1229273713_0017_m_000000_0
2015-02-11 00:44:23,861 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:23,862 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:23,863 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:23,863 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:23,873 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:23,873 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:23,875 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:23,875 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:23,875 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:23,875 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:23,876 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:23,877 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:23,877 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:23,877 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:23,884 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:23,884 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_RESULTS"]
2015-02-11 00:44:23,897 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1229273713_0017_r_000000_0 is done. And is in the process of committing
2015-02-11 00:44:23,899 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:23,899 INFO  mapred.Task (Task.java:commit(1162)) - Task attempt_local1229273713_0017_r_000000_0 is allowed to commit now
2015-02-11 00:44:23,900 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1229273713_0017_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_RESULTS/_temporary/0/task_local1229273713_0017_r_000000
2015-02-11 00:44:23,901 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:23,901 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1229273713_0017_r_000000_0' done.
2015-02-11 00:44:23,901 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1229273713_0017_r_000000_0
2015-02-11 00:44:23,902 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:23,927 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_RESULTS/_temporary
2015-02-11 00:44:23,957 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:23,989 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:23,990 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_RESULTS
2015-02-11 00:44:24,007 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:24,008 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:24,013 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_ALL
2015-02-11 00:44:24,029 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:24,032 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:24,038 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:24,040 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:24,040 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:24,045 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:24,045 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:24,045 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_REPLACE"]
2015-02-11 00:44:24,045 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:24,045 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:24,045 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:24,046 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...yplatform/-1_ARGS_REPLACE
2015-02-11 00:44:24,047 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:24,048 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:24,074 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:24,093 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:24,109 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local457598278_0018
2015-02-11 00:44:24,127 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity457598278/.staging/job_local457598278_0018/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:24,128 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity457598278/.staging/job_local457598278_0018/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:24,177 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local457598278_0018/job_local457598278_0018.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:24,179 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local457598278_0018/job_local457598278_0018.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:24,179 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:24,180 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local457598278_0018
2015-02-11 00:44:24,180 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:24,180 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:24,181 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:24,183 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:24,184 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local457598278_0018_m_000000_0
2015-02-11 00:44:24,185 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:24,186 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:24,187 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@4a46ee9d
2015-02-11 00:44:24,188 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:24,188 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:24,338 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:24,338 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:24,339 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:24,339 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:24,339 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:24,340 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:24,340 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:24,347 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:24,347 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:24,351 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:24,351 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:24,351 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:24,352 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:24,352 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:24,355 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:24,357 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local457598278_0018_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:24,359 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:24,359 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local457598278_0018_m_000000_0' done.
2015-02-11 00:44:24,359 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local457598278_0018_m_000000_0
2015-02-11 00:44:24,360 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:24,360 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:24,360 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local457598278_0018_r_000000_0
2015-02-11 00:44:24,362 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:24,362 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@db5eaed
2015-02-11 00:44:24,363 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:24,364 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local457598278_0018_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:24,365 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#18 about to shuffle output of map attempt_local457598278_0018_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:24,366 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local457598278_0018_m_000000_0
2015-02-11 00:44:24,366 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:24,367 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:24,368 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:24,368 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:24,371 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:24,371 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:24,373 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:24,373 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:24,373 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:24,373 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:24,374 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:24,374 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:24,375 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:24,375 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:24,381 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:24,381 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_REPLACE"]
2015-02-11 00:44:24,395 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local457598278_0018_r_000000_0 is done. And is in the process of committing
2015-02-11 00:44:24,397 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:24,397 INFO  mapred.Task (Task.java:commit(1162)) - Task attempt_local457598278_0018_r_000000_0 is allowed to commit now
2015-02-11 00:44:24,398 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local457598278_0018_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_REPLACE/_temporary/0/task_local457598278_0018_r_000000
2015-02-11 00:44:24,399 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:24,399 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local457598278_0018_r_000000_0' done.
2015-02-11 00:44:24,399 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local457598278_0018_r_000000_0
2015-02-11 00:44:24,399 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:24,420 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_REPLACE/_temporary
2015-02-11 00:44:24,450 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:24,483 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:24,484 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_REPLACE
2015-02-11 00:44:24,501 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:24,502 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:24,508 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:24,510 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:24,510 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:24,514 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:24,515 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:24,515 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_SWAP"]
2015-02-11 00:44:24,515 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:24,515 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:24,515 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:24,516 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...mblyplatform/-1_ARGS_SWAP
2015-02-11 00:44:24,517 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:24,518 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:24,542 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:24,562 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:24,578 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local2090243377_0019
2015-02-11 00:44:24,599 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity2090243377/.staging/job_local2090243377_0019/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:24,600 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity2090243377/.staging/job_local2090243377_0019/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:24,664 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2090243377_0019/job_local2090243377_0019.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:24,666 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2090243377_0019/job_local2090243377_0019.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:24,666 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:24,667 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local2090243377_0019
2015-02-11 00:44:24,667 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:24,667 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:24,667 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:24,670 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:24,670 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local2090243377_0019_m_000000_0
2015-02-11 00:44:24,672 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:24,674 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:24,674 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@111de95a
2015-02-11 00:44:24,676 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:24,676 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:24,702 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:24,702 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:24,702 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:24,702 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:24,702 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:24,704 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:24,704 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:24,712 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:24,713 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:24,716 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:24,717 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:24,717 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:24,717 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:24,717 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:24,721 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:24,723 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local2090243377_0019_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:24,725 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:24,725 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local2090243377_0019_m_000000_0' done.
2015-02-11 00:44:24,726 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local2090243377_0019_m_000000_0
2015-02-11 00:44:24,726 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:24,727 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:24,727 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local2090243377_0019_r_000000_0
2015-02-11 00:44:24,729 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:24,729 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@153043cc
2015-02-11 00:44:24,729 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:24,730 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local2090243377_0019_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:24,732 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#19 about to shuffle output of map attempt_local2090243377_0019_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:24,732 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local2090243377_0019_m_000000_0
2015-02-11 00:44:24,733 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:24,733 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:24,736 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:24,736 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:24,739 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:24,739 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:24,741 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:24,742 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:24,742 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:24,742 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:24,743 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:24,743 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:24,744 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:24,744 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:24,750 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:24,751 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_SWAP"]
2015-02-11 00:44:24,764 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local2090243377_0019_r_000000_0 is done. And is in the process of committing
2015-02-11 00:44:24,766 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:24,766 INFO  mapred.Task (Task.java:commit(1162)) - Task attempt_local2090243377_0019_r_000000_0 is allowed to commit now
2015-02-11 00:44:24,767 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local2090243377_0019_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_SWAP/_temporary/0/task_local2090243377_0019_r_000000
2015-02-11 00:44:24,769 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:24,769 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local2090243377_0019_r_000000_0' done.
2015-02-11 00:44:24,769 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local2090243377_0019_r_000000_0
2015-02-11 00:44:24,770 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:24,789 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_SWAP/_temporary
2015-02-11 00:44:24,825 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:24,863 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:24,865 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_SWAP
2015-02-11 00:44:24,888 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:24,889 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:24,899 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:24,902 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:24,903 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:24,909 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:24,910 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:24,910 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_-1"]
2015-02-11 00:44:24,911 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:24,911 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:24,911 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:24,912 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...mblyplatform/0_'field'_-1
2015-02-11 00:44:24,913 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:24,914 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:24,941 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:24,962 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:24,988 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1880985790_0020
2015-02-11 00:44:25,014 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1880985790/.staging/job_local1880985790_0020/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:25,016 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1880985790/.staging/job_local1880985790_0020/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:25,086 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1880985790_0020/job_local1880985790_0020.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:25,088 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1880985790_0020/job_local1880985790_0020.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:25,089 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:25,089 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1880985790_0020
2015-02-11 00:44:25,089 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:25,089 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:25,090 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:25,093 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:25,093 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1880985790_0020_m_000000_0
2015-02-11 00:44:25,095 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:25,096 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:25,097 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@63f7d32f
2015-02-11 00:44:25,098 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:25,098 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:25,117 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:25,117 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:25,117 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:25,117 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:25,117 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:25,119 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:25,119 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:25,125 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:25,125 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:25,129 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:25,129 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:25,129 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:25,130 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:25,130 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:25,133 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:25,136 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1880985790_0020_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:25,137 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:25,138 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1880985790_0020_m_000000_0' done.
2015-02-11 00:44:25,138 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1880985790_0020_m_000000_0
2015-02-11 00:44:25,138 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:25,139 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:25,139 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1880985790_0020_r_000000_0
2015-02-11 00:44:25,141 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:25,141 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@23390fca
2015-02-11 00:44:25,142 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=512930592, maxSingleShuffleLimit=128232648, mergeThreshold=338534208, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:25,143 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1880985790_0020_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:25,144 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#20 about to shuffle output of map attempt_local1880985790_0020_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:25,145 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1880985790_0020_m_000000_0
2015-02-11 00:44:25,145 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:25,146 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:25,147 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:25,148 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:25,153 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:25,153 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:25,156 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:25,156 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:25,157 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:25,157 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:25,158 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:25,159 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:25,160 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:25,160 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:25,166 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:25,167 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_-1"]
2015-02-11 00:44:25,181 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1880985790_0020_r_000000_0 is done. And is in the process of committing
2015-02-11 00:44:25,183 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:25,183 INFO  mapred.Task (Task.java:commit(1162)) - Task attempt_local1880985790_0020_r_000000_0 is allowed to commit now
2015-02-11 00:44:25,184 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1880985790_0020_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_-1/_temporary/0/task_local1880985790_0020_r_000000
2015-02-11 00:44:25,185 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:25,186 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1880985790_0020_r_000000_0' done.
2015-02-11 00:44:25,186 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1880985790_0020_r_000000_0
2015-02-11 00:44:25,186 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:25,208 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_-1/_temporary
2015-02-11 00:44:25,240 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:25,273 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:25,274 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_'field'_-1
2015-02-11 00:44:25,296 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:25,296 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:25,304 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:25,307 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:25,307 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:25,312 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:25,312 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:25,313 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_'field'"]
2015-02-11 00:44:25,313 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:25,313 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:25,313 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:25,314 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...latform/0_'field'_'field'
2015-02-11 00:44:25,315 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:25,316 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:25,341 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:25,360 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:25,382 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local2144287873_0021
2015-02-11 00:44:25,402 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity2144287873/.staging/job_local2144287873_0021/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:25,404 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity2144287873/.staging/job_local2144287873_0021/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:25,469 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2144287873_0021/job_local2144287873_0021.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:25,470 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2144287873_0021/job_local2144287873_0021.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:25,471 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:25,472 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local2144287873_0021
2015-02-11 00:44:25,472 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:25,472 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:25,472 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:25,476 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:25,476 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local2144287873_0021_m_000000_0
2015-02-11 00:44:25,478 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:25,480 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:25,480 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@4605a23b
2015-02-11 00:44:25,481 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:25,481 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:25,508 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:25,508 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:25,508 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:25,508 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:25,508 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:25,510 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:25,510 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:25,518 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:25,518 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:25,522 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:25,522 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:25,522 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:25,523 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:25,523 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:25,526 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:25,529 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local2144287873_0021_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:25,531 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:25,531 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local2144287873_0021_m_000000_0' done.
2015-02-11 00:44:25,531 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local2144287873_0021_m_000000_0
2015-02-11 00:44:25,531 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:25,532 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:25,532 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local2144287873_0021_r_000000_0
2015-02-11 00:44:25,533 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:25,534 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@387db6c5
2015-02-11 00:44:25,534 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=514719744, maxSingleShuffleLimit=128679936, mergeThreshold=339715040, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:25,535 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local2144287873_0021_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:25,537 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#21 about to shuffle output of map attempt_local2144287873_0021_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:25,537 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local2144287873_0021_m_000000_0
2015-02-11 00:44:25,537 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:25,538 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:25,539 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:25,540 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:25,542 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:25,542 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:25,544 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:25,544 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:25,544 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:25,544 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:25,545 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:25,545 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:25,546 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:25,546 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:25,552 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:25,552 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_'field'"]
2015-02-11 00:44:25,565 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local2144287873_0021_r_000000_0 is done. And is in the process of committing
2015-02-11 00:44:25,566 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:25,567 INFO  mapred.Task (Task.java:commit(1162)) - Task attempt_local2144287873_0021_r_000000_0 is allowed to commit now
2015-02-11 00:44:25,567 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local2144287873_0021_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_'field'/_temporary/0/task_local2144287873_0021_r_000000
2015-02-11 00:44:25,568 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:25,569 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local2144287873_0021_r_000000_0' done.
2015-02-11 00:44:25,569 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local2144287873_0021_r_000000_0
2015-02-11 00:44:25,569 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:25,586 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_'field'/_temporary
2015-02-11 00:44:25,616 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:25,650 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:25,651 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_'field'_'field'
2015-02-11 00:44:25,668 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:25,669 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:25,674 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:25,676 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:25,677 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:25,681 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:25,681 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:25,681 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_RESULTS"]
2015-02-11 00:44:25,681 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:25,682 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:25,682 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:25,682 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...latform/0_'field'_RESULTS
2015-02-11 00:44:25,683 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:25,685 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:25,711 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:25,730 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:25,746 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1550234773_0022
2015-02-11 00:44:25,765 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1550234773/.staging/job_local1550234773_0022/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:25,766 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1550234773/.staging/job_local1550234773_0022/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:25,820 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1550234773_0022/job_local1550234773_0022.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:25,822 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1550234773_0022/job_local1550234773_0022.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:25,823 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:25,823 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:25,824 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:25,824 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1550234773_0022
2015-02-11 00:44:25,824 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:25,826 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:25,827 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1550234773_0022_m_000000_0
2015-02-11 00:44:25,828 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:25,830 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:25,831 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@364e33aa
2015-02-11 00:44:25,832 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:25,832 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:25,858 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:25,859 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:25,859 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:25,859 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:25,859 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:25,860 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:25,861 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:25,869 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:25,869 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:25,873 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:25,873 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:25,873 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:25,873 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:25,873 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:25,877 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:25,879 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1550234773_0022_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:25,881 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:25,881 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1550234773_0022_m_000000_0' done.
2015-02-11 00:44:25,881 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1550234773_0022_m_000000_0
2015-02-11 00:44:25,881 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:25,882 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:25,882 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1550234773_0022_r_000000_0
2015-02-11 00:44:25,884 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:25,884 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@7a95d502
2015-02-11 00:44:25,885 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=551374016, maxSingleShuffleLimit=137843504, mergeThreshold=363906880, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:25,885 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1550234773_0022_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:25,887 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#22 about to shuffle output of map attempt_local1550234773_0022_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:25,888 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1550234773_0022_m_000000_0
2015-02-11 00:44:25,888 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:25,889 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:25,890 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:25,891 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:25,893 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:25,893 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:25,896 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:25,896 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:25,897 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:25,897 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:25,898 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:25,898 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:25,899 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:25,899 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:25,905 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:25,906 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_RESULTS"]
2015-02-11 00:44:25,919 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1550234773_0022_r_000000_0 is done. And is in the process of committing
2015-02-11 00:44:25,920 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:25,920 INFO  mapred.Task (Task.java:commit(1162)) - Task attempt_local1550234773_0022_r_000000_0 is allowed to commit now
2015-02-11 00:44:25,921 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1550234773_0022_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_RESULTS/_temporary/0/task_local1550234773_0022_r_000000
2015-02-11 00:44:25,922 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:25,923 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1550234773_0022_r_000000_0' done.
2015-02-11 00:44:25,923 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1550234773_0022_r_000000_0
2015-02-11 00:44:25,923 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:25,947 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_RESULTS/_temporary
2015-02-11 00:44:25,978 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:26,011 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:26,012 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_'field'_RESULTS
2015-02-11 00:44:26,013 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:26,031 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:26,031 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:26,037 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:26,039 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:26,040 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:26,044 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:26,044 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:26,044 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_ALL"]
2015-02-11 00:44:26,045 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:26,045 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:26,045 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:26,047 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...blyplatform/0_'field'_ALL
2015-02-11 00:44:26,047 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:26,048 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:26,073 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:26,091 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:26,107 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local2033029076_0023
2015-02-11 00:44:26,125 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity2033029076/.staging/job_local2033029076_0023/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:26,126 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity2033029076/.staging/job_local2033029076_0023/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:26,174 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2033029076_0023/job_local2033029076_0023.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:26,176 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2033029076_0023/job_local2033029076_0023.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:26,176 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:26,177 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local2033029076_0023
2015-02-11 00:44:26,177 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:26,177 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:26,177 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:26,180 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:26,180 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local2033029076_0023_m_000000_0
2015-02-11 00:44:26,182 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:26,184 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:26,184 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@38246607
2015-02-11 00:44:26,185 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:26,185 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:26,210 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:26,211 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:26,211 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:26,211 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:26,211 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:26,212 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:26,212 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:26,221 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:26,221 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:26,225 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:26,225 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:26,225 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:26,226 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:26,226 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:26,229 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:26,231 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local2033029076_0023_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:26,233 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:26,233 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local2033029076_0023_m_000000_0' done.
2015-02-11 00:44:26,233 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local2033029076_0023_m_000000_0
2015-02-11 00:44:26,233 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:26,234 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:26,234 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local2033029076_0023_r_000000_0
2015-02-11 00:44:26,236 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:26,236 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@a70cf21
2015-02-11 00:44:26,236 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=551557504, maxSingleShuffleLimit=137889376, mergeThreshold=364027968, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:26,237 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local2033029076_0023_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:26,239 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#23 about to shuffle output of map attempt_local2033029076_0023_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:26,239 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local2033029076_0023_m_000000_0
2015-02-11 00:44:26,239 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:26,240 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:26,241 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:26,241 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:26,244 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:26,245 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:26,246 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:26,247 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:26,247 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:26,247 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:26,247 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:26,248 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:26,248 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:26,248 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:26,254 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:26,254 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_ALL"]
2015-02-11 00:44:26,267 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local2033029076_0023_r_000000_0 is done. And is in the process of committing
2015-02-11 00:44:26,270 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:26,270 INFO  mapred.Task (Task.java:commit(1162)) - Task attempt_local2033029076_0023_r_000000_0 is allowed to commit now
2015-02-11 00:44:26,270 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local2033029076_0023_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_ALL/_temporary/0/task_local2033029076_0023_r_000000
2015-02-11 00:44:26,272 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:26,272 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local2033029076_0023_r_000000_0' done.
2015-02-11 00:44:26,272 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local2033029076_0023_r_000000_0
2015-02-11 00:44:26,272 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:26,287 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_ALL/_temporary
2015-02-11 00:44:26,317 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:26,347 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:26,349 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_'field'_ALL
2015-02-11 00:44:26,366 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:26,366 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:26,371 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_'field'_REPLACE
2015-02-11 00:44:26,388 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:26,388 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:26,394 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:26,398 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:26,398 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:26,403 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:26,403 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:26,404 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_SWAP"]
2015-02-11 00:44:26,404 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:26,404 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:26,404 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:26,405 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...lyplatform/0_'field'_SWAP
2015-02-11 00:44:26,405 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:26,406 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:26,433 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:26,453 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:26,469 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1683908648_0024
2015-02-11 00:44:26,487 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1683908648/.staging/job_local1683908648_0024/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:26,488 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1683908648/.staging/job_local1683908648_0024/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:26,538 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1683908648_0024/job_local1683908648_0024.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:26,539 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1683908648_0024/job_local1683908648_0024.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:26,539 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:26,541 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:26,541 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1683908648_0024
2015-02-11 00:44:26,542 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:26,542 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:26,544 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:26,544 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1683908648_0024_m_000000_0
2015-02-11 00:44:26,546 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:26,547 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:26,547 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@2cd0a9b2
2015-02-11 00:44:26,548 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:26,549 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:26,574 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:26,574 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:26,574 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:26,575 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:26,575 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:26,576 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:26,576 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:26,584 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:26,584 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:26,588 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:26,588 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:26,588 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:26,589 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:26,589 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:26,592 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:26,594 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1683908648_0024_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:26,596 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:26,596 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1683908648_0024_m_000000_0' done.
2015-02-11 00:44:26,597 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1683908648_0024_m_000000_0
2015-02-11 00:44:26,597 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:26,597 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:26,598 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1683908648_0024_r_000000_0
2015-02-11 00:44:26,600 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:26,600 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@87d53d8
2015-02-11 00:44:26,601 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=551465792, maxSingleShuffleLimit=137866448, mergeThreshold=363967424, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:26,601 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1683908648_0024_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:26,603 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#24 about to shuffle output of map attempt_local1683908648_0024_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:26,603 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1683908648_0024_m_000000_0
2015-02-11 00:44:26,604 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:26,604 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:26,605 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:26,606 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:26,608 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:26,608 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:26,610 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:26,610 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:26,611 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:26,611 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:26,611 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:26,612 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:26,612 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:26,612 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:26,618 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:26,618 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_SWAP"]
2015-02-11 00:44:26,631 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1683908648_0024_r_000000_0 is done. And is in the process of committing
2015-02-11 00:44:26,632 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:26,633 INFO  mapred.Task (Task.java:commit(1162)) - Task attempt_local1683908648_0024_r_000000_0 is allowed to commit now
2015-02-11 00:44:26,633 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1683908648_0024_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_SWAP/_temporary/0/task_local1683908648_0024_r_000000
2015-02-11 00:44:26,634 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:26,635 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1683908648_0024_r_000000_0' done.
2015-02-11 00:44:26,635 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1683908648_0024_r_000000_0
2015-02-11 00:44:26,635 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:26,650 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_SWAP/_temporary
2015-02-11 00:44:26,680 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:26,712 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:26,714 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_'field'_SWAP
2015-02-11 00:44:26,733 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:26,733 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:26,740 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:26,741 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:26,742 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:26,746 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:26,746 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:26,746 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_-1"]
2015-02-11 00:44:26,746 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:26,747 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:26,747 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:26,747 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...mblyplatform/0_UNKNOWN_-1
2015-02-11 00:44:26,748 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:26,749 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:26,773 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:26,793 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:26,809 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1222931345_0025
2015-02-11 00:44:26,827 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1222931345/.staging/job_local1222931345_0025/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:26,828 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1222931345/.staging/job_local1222931345_0025/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:26,879 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1222931345_0025/job_local1222931345_0025.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:26,880 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1222931345_0025/job_local1222931345_0025.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:26,881 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:26,881 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1222931345_0025
2015-02-11 00:44:26,882 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:26,882 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:26,882 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:26,885 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:26,885 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1222931345_0025_m_000000_0
2015-02-11 00:44:26,887 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:26,888 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:26,888 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@49b0a981
2015-02-11 00:44:26,889 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:26,889 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:26,915 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:26,915 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:26,916 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:26,916 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:26,916 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:26,919 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:26,919 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:26,925 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:26,925 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:26,928 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:26,929 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:26,929 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:26,929 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:26,929 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:26,932 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:26,934 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1222931345_0025_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:26,936 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:26,936 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1222931345_0025_m_000000_0' done.
2015-02-11 00:44:26,936 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1222931345_0025_m_000000_0
2015-02-11 00:44:26,937 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:26,937 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:26,938 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1222931345_0025_r_000000_0
2015-02-11 00:44:26,939 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:26,939 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@487cc5c2
2015-02-11 00:44:26,940 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=551695168, maxSingleShuffleLimit=137923792, mergeThreshold=364118816, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:26,941 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1222931345_0025_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:26,942 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#25 about to shuffle output of map attempt_local1222931345_0025_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:26,943 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1222931345_0025_m_000000_0
2015-02-11 00:44:26,943 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:26,944 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:26,945 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:26,945 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:26,949 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:26,949 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:26,952 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:26,952 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:26,952 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:26,952 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:26,953 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:26,954 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:26,954 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:26,954 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:26,960 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:26,960 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_-1"]
2015-02-11 00:44:26,973 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1222931345_0025_r_000000_0 is done. And is in the process of committing
2015-02-11 00:44:26,975 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:26,975 INFO  mapred.Task (Task.java:commit(1162)) - Task attempt_local1222931345_0025_r_000000_0 is allowed to commit now
2015-02-11 00:44:26,976 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1222931345_0025_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_-1/_temporary/0/task_local1222931345_0025_r_000000
2015-02-11 00:44:26,977 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:26,977 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1222931345_0025_r_000000_0' done.
2015-02-11 00:44:26,977 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1222931345_0025_r_000000_0
2015-02-11 00:44:26,977 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:26,992 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_-1/_temporary
2015-02-11 00:44:27,022 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:27,052 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:27,053 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_-1
2015-02-11 00:44:27,070 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:27,071 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:27,075 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_'field'
2015-02-11 00:44:27,092 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:27,092 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:27,099 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:27,101 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:27,102 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:27,105 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:27,105 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:27,106 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_RESULTS"]
2015-02-11 00:44:27,106 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:27,106 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:27,106 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:27,107 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...latform/0_UNKNOWN_RESULTS
2015-02-11 00:44:27,107 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:27,108 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:27,134 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:27,135 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:27,154 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:27,170 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local813624964_0026
2015-02-11 00:44:27,188 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity813624964/.staging/job_local813624964_0026/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:27,189 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity813624964/.staging/job_local813624964_0026/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:27,240 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local813624964_0026/job_local813624964_0026.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:27,241 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local813624964_0026/job_local813624964_0026.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:27,242 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:27,243 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:27,243 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:27,243 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local813624964_0026
2015-02-11 00:44:27,244 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:27,245 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:27,246 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local813624964_0026_m_000000_0
2015-02-11 00:44:27,248 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:27,250 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:27,250 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@1cfda6e5
2015-02-11 00:44:27,252 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:27,252 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:27,278 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:27,278 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:27,278 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:27,278 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:27,278 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:27,280 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:27,280 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:27,285 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:27,286 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:27,289 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:27,289 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:27,289 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:27,290 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:27,290 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:27,293 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:27,295 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local813624964_0026_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:27,297 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:27,297 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local813624964_0026_m_000000_0' done.
2015-02-11 00:44:27,297 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local813624964_0026_m_000000_0
2015-02-11 00:44:27,297 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:27,298 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:27,298 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local813624964_0026_r_000000_0
2015-02-11 00:44:27,300 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:27,300 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@90901ce
2015-02-11 00:44:27,300 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=551786880, maxSingleShuffleLimit=137946720, mergeThreshold=364179360, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:27,301 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local813624964_0026_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:27,303 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#26 about to shuffle output of map attempt_local813624964_0026_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:27,304 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local813624964_0026_m_000000_0
2015-02-11 00:44:27,304 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:27,305 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:27,306 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:27,306 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:27,310 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:27,310 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:27,312 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:27,312 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:27,312 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:27,312 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:27,313 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:27,314 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:27,314 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:27,314 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:27,320 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:27,320 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_RESULTS"]
2015-02-11 00:44:27,332 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local813624964_0026_r_000000_0 is done. And is in the process of committing
2015-02-11 00:44:27,334 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:27,334 INFO  mapred.Task (Task.java:commit(1162)) - Task attempt_local813624964_0026_r_000000_0 is allowed to commit now
2015-02-11 00:44:27,335 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local813624964_0026_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_RESULTS/_temporary/0/task_local813624964_0026_r_000000
2015-02-11 00:44:27,336 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:27,336 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local813624964_0026_r_000000_0' done.
2015-02-11 00:44:27,336 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local813624964_0026_r_000000_0
2015-02-11 00:44:27,337 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:27,355 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_RESULTS/_temporary
2015-02-11 00:44:27,386 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:27,417 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:27,418 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_RESULTS
2015-02-11 00:44:27,436 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:27,436 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:27,442 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:27,444 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:27,444 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:27,448 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:27,448 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:27,448 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_ALL"]
2015-02-11 00:44:27,449 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:27,449 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:27,449 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:27,449 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...blyplatform/0_UNKNOWN_ALL
2015-02-11 00:44:27,450 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:27,451 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:27,476 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:27,495 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:27,511 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1638275050_0027
2015-02-11 00:44:27,530 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1638275050/.staging/job_local1638275050_0027/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:27,531 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1638275050/.staging/job_local1638275050_0027/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:27,583 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1638275050_0027/job_local1638275050_0027.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:27,583 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:27,584 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1638275050_0027/job_local1638275050_0027.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:27,585 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:27,585 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1638275050_0027
2015-02-11 00:44:27,586 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:27,586 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:27,587 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:27,589 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:27,589 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1638275050_0027_m_000000_0
2015-02-11 00:44:27,591 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:27,592 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:27,592 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@2c72dc45
2015-02-11 00:44:27,593 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:27,594 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:27,619 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:27,619 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:27,619 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:27,619 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:27,619 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:27,621 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:27,621 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:27,626 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:27,626 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:27,630 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:27,630 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:27,630 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:27,630 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:27,630 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:27,633 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:27,635 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1638275050_0027_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:27,637 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:27,637 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1638275050_0027_m_000000_0' done.
2015-02-11 00:44:27,637 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1638275050_0027_m_000000_0
2015-02-11 00:44:27,637 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:27,638 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:27,638 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1638275050_0027_r_000000_0
2015-02-11 00:44:27,640 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:27,640 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@30056042
2015-02-11 00:44:27,640 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=551970368, maxSingleShuffleLimit=137992592, mergeThreshold=364300448, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:27,641 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1638275050_0027_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:27,643 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#27 about to shuffle output of map attempt_local1638275050_0027_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:27,643 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1638275050_0027_m_000000_0
2015-02-11 00:44:27,643 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:27,644 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:27,645 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:27,645 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:27,647 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:27,648 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:27,649 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:27,650 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:27,650 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:27,651 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:27,651 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:27,652 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:27,652 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:27,653 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:27,657 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:27,658 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_ALL"]
2015-02-11 00:44:27,671 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1638275050_0027_r_000000_0 is done. And is in the process of committing
2015-02-11 00:44:27,672 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:27,672 INFO  mapred.Task (Task.java:commit(1162)) - Task attempt_local1638275050_0027_r_000000_0 is allowed to commit now
2015-02-11 00:44:27,673 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1638275050_0027_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_ALL/_temporary/0/task_local1638275050_0027_r_000000
2015-02-11 00:44:27,675 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:27,675 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1638275050_0027_r_000000_0' done.
2015-02-11 00:44:27,675 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1638275050_0027_r_000000_0
2015-02-11 00:44:27,676 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:27,696 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_ALL/_temporary
2015-02-11 00:44:27,725 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:27,757 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:27,759 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_ALL
2015-02-11 00:44:27,775 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:27,775 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:27,781 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:27,783 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:27,783 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:27,787 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:27,787 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:27,787 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_REPLACE"]
2015-02-11 00:44:27,787 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:27,787 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:27,787 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:27,788 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...latform/0_UNKNOWN_REPLACE
2015-02-11 00:44:27,789 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:27,790 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:27,813 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:27,833 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:27,848 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1133150260_0028
2015-02-11 00:44:27,865 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1133150260/.staging/job_local1133150260_0028/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:27,866 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1133150260/.staging/job_local1133150260_0028/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:27,914 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1133150260_0028/job_local1133150260_0028.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:27,915 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1133150260_0028/job_local1133150260_0028.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:27,915 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:27,916 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1133150260_0028
2015-02-11 00:44:27,916 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:27,916 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:27,916 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:27,919 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:27,919 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1133150260_0028_m_000000_0
2015-02-11 00:44:27,921 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:27,922 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:27,923 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@35563b4b
2015-02-11 00:44:27,924 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:27,924 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:27,950 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:27,950 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:27,951 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:27,951 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:27,951 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:27,952 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:27,952 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:27,957 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:27,957 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:27,961 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:27,961 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:27,962 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:27,962 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:27,962 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:27,965 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:27,967 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1133150260_0028_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:27,969 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:27,969 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1133150260_0028_m_000000_0' done.
2015-02-11 00:44:27,969 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1133150260_0028_m_000000_0
2015-02-11 00:44:27,970 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:27,970 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:27,970 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1133150260_0028_r_000000_0
2015-02-11 00:44:27,972 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:27,972 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@50eee4dc
2015-02-11 00:44:27,973 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552016256, maxSingleShuffleLimit=138004064, mergeThreshold=364330752, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:27,973 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1133150260_0028_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:27,975 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#28 about to shuffle output of map attempt_local1133150260_0028_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:27,976 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1133150260_0028_m_000000_0
2015-02-11 00:44:27,976 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:27,976 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:27,977 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:27,978 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:27,981 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:27,981 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:27,985 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:27,985 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:27,985 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:27,986 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:27,986 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:27,987 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:27,987 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:27,987 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:27,992 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:27,992 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_REPLACE"]
2015-02-11 00:44:28,001 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-11 00:44:28,002 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:28,006 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:28,052 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1133150260_0028
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-11 00:44:28,062 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local1133150260_0028 state at FAILED
2015-02-11 00:44:28,062 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-11 00:44:28,062 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-11 00:44:28,062 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-11 00:44:28,067 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-11 00:44:28,067 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...latform/0_UNKNOWN_REPLACE
2015-02-11 00:44:28,068 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-11 00:44:28,068 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_REPLACE/_temporary
2015-02-11 00:44:28,069 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_REPLACE
2015-02-11 00:44:28,085 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:28,085 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:28,091 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:28,093 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:28,093 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:28,097 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:28,097 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:28,097 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_SWAP"]
2015-02-11 00:44:28,097 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:28,098 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:28,098 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:28,099 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...lyplatform/0_UNKNOWN_SWAP
2015-02-11 00:44:28,099 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:28,100 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:28,124 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:28,142 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:28,158 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local2055047559_0029
2015-02-11 00:44:28,175 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity2055047559/.staging/job_local2055047559_0029/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:28,176 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity2055047559/.staging/job_local2055047559_0029/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:28,225 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2055047559_0029/job_local2055047559_0029.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:28,226 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2055047559_0029/job_local2055047559_0029.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:28,227 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:28,227 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local2055047559_0029
2015-02-11 00:44:28,227 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:28,227 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:28,227 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:28,230 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:28,230 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local2055047559_0029_m_000000_0
2015-02-11 00:44:28,232 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:28,233 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:28,234 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@1c466919
2015-02-11 00:44:28,235 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:28,235 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:28,260 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:28,261 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:28,261 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:28,261 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:28,262 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:28,263 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:28,263 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:28,270 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:28,270 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:28,273 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:28,274 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:28,274 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:28,274 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:28,274 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:28,277 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:28,279 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local2055047559_0029_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:28,281 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:28,281 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local2055047559_0029_m_000000_0' done.
2015-02-11 00:44:28,281 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local2055047559_0029_m_000000_0
2015-02-11 00:44:28,281 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:28,282 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:28,282 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local2055047559_0029_r_000000_0
2015-02-11 00:44:28,284 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:28,284 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@1151000a
2015-02-11 00:44:28,285 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552153920, maxSingleShuffleLimit=138038480, mergeThreshold=364421600, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:28,286 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local2055047559_0029_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:28,288 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#29 about to shuffle output of map attempt_local2055047559_0029_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:28,288 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local2055047559_0029_m_000000_0
2015-02-11 00:44:28,288 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:28,289 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:28,290 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:28,291 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:28,296 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:28,296 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:28,298 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:28,299 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:28,299 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:28,299 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:28,300 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:28,301 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:28,301 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:28,302 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:28,306 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:28,307 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_SWAP"]
2015-02-11 00:44:28,320 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local2055047559_0029_r_000000_0 is done. And is in the process of committing
2015-02-11 00:44:28,321 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:28,322 INFO  mapred.Task (Task.java:commit(1162)) - Task attempt_local2055047559_0029_r_000000_0 is allowed to commit now
2015-02-11 00:44:28,322 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local2055047559_0029_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_SWAP/_temporary/0/task_local2055047559_0029_r_000000
2015-02-11 00:44:28,324 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:28,324 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local2055047559_0029_r_000000_0' done.
2015-02-11 00:44:28,324 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local2055047559_0029_r_000000_0
2015-02-11 00:44:28,325 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:28,347 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_SWAP/_temporary
2015-02-11 00:44:28,376 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:28,409 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:28,409 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:28,410 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_SWAP
2015-02-11 00:44:28,426 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:28,427 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:28,432 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:28,434 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:28,434 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:28,438 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:28,438 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:28,439 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_-1"]
2015-02-11 00:44:28,439 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:28,439 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:28,440 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:28,440 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...emblyplatform/0_VALUES_-1
2015-02-11 00:44:28,441 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:28,442 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:28,467 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:28,485 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:28,501 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local643267711_0030
2015-02-11 00:44:28,519 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity643267711/.staging/job_local643267711_0030/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:28,520 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity643267711/.staging/job_local643267711_0030/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:28,568 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local643267711_0030/job_local643267711_0030.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:28,569 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local643267711_0030/job_local643267711_0030.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:28,570 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:28,570 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local643267711_0030
2015-02-11 00:44:28,570 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:28,570 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:28,570 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:28,573 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:28,573 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local643267711_0030_m_000000_0
2015-02-11 00:44:28,575 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:28,576 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:28,576 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@395e7bc4
2015-02-11 00:44:28,578 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:28,578 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:28,604 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:28,604 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:28,604 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:28,604 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:28,604 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:28,605 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:28,606 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:28,613 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:28,613 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:28,618 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:28,618 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:28,618 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:28,618 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:28,619 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:28,622 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:28,623 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local643267711_0030_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:28,625 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:28,625 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local643267711_0030_m_000000_0' done.
2015-02-11 00:44:28,626 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local643267711_0030_m_000000_0
2015-02-11 00:44:28,626 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:28,626 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:28,627 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local643267711_0030_r_000000_0
2015-02-11 00:44:28,628 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:28,629 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@4a1b4407
2015-02-11 00:44:28,629 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552153920, maxSingleShuffleLimit=138038480, mergeThreshold=364421600, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:28,630 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local643267711_0030_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:28,632 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#30 about to shuffle output of map attempt_local643267711_0030_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:28,632 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local643267711_0030_m_000000_0
2015-02-11 00:44:28,632 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:28,633 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:28,635 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:28,635 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:28,637 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:28,638 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:28,639 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:28,640 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:28,640 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:28,640 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:28,640 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:28,641 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:28,641 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:28,642 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:28,646 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:28,646 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_-1"]
2015-02-11 00:44:28,655 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-11 00:44:28,656 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:28,658 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local643267711_0030
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-11 00:44:28,665 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local643267711_0030 state at FAILED
2015-02-11 00:44:28,665 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-11 00:44:28,665 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-11 00:44:28,665 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-11 00:44:28,671 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-11 00:44:28,671 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...emblyplatform/0_VALUES_-1
2015-02-11 00:44:28,672 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-11 00:44:28,672 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_-1/_temporary
2015-02-11 00:44:28,672 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_VALUES_-1
2015-02-11 00:44:28,689 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:28,689 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:28,694 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_VALUES_'field'
2015-02-11 00:44:28,710 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:28,711 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:28,716 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:28,718 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:28,719 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:28,722 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:28,722 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:28,723 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_RESULTS"]
2015-02-11 00:44:28,723 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:28,723 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:28,723 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:28,724 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...platform/0_VALUES_RESULTS
2015-02-11 00:44:28,724 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:28,725 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:28,749 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:28,768 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:28,784 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local881270241_0031
2015-02-11 00:44:28,801 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity881270241/.staging/job_local881270241_0031/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:28,802 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity881270241/.staging/job_local881270241_0031/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:28,849 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local881270241_0031/job_local881270241_0031.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:28,850 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local881270241_0031/job_local881270241_0031.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:28,851 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:28,853 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local881270241_0031
2015-02-11 00:44:28,853 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:28,853 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:28,853 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:28,856 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:28,856 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local881270241_0031_m_000000_0
2015-02-11 00:44:28,857 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:28,859 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:28,859 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@327958ef
2015-02-11 00:44:28,860 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:28,860 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:28,886 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:28,886 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:28,886 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:28,886 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:28,886 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:28,887 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:28,888 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:28,892 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:28,893 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:28,896 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:28,896 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:28,897 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:28,897 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:28,897 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:28,900 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:28,902 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local881270241_0031_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:28,903 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:28,904 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local881270241_0031_m_000000_0' done.
2015-02-11 00:44:28,904 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local881270241_0031_m_000000_0
2015-02-11 00:44:28,904 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:28,904 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:28,905 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local881270241_0031_r_000000_0
2015-02-11 00:44:28,906 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:28,906 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@19f9bdc4
2015-02-11 00:44:28,908 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552337408, maxSingleShuffleLimit=138084352, mergeThreshold=364542688, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:28,909 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local881270241_0031_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:28,910 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#31 about to shuffle output of map attempt_local881270241_0031_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:28,911 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local881270241_0031_m_000000_0
2015-02-11 00:44:28,911 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:28,912 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:28,913 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:28,913 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:28,915 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:28,915 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:28,917 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:28,917 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:28,917 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:28,917 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:28,917 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:28,918 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:28,918 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:28,919 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:28,923 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:28,923 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_RESULTS"]
2015-02-11 00:44:28,928 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:28,932 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-11 00:44:28,933 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:28,935 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local881270241_0031
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-11 00:44:28,937 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local881270241_0031 state at FAILED
2015-02-11 00:44:28,937 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-11 00:44:28,937 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-11 00:44:28,937 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-11 00:44:28,941 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-11 00:44:28,941 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...platform/0_VALUES_RESULTS
2015-02-11 00:44:28,942 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-11 00:44:28,942 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_RESULTS/_temporary
2015-02-11 00:44:28,943 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_VALUES_RESULTS
2015-02-11 00:44:28,961 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:28,962 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:28,967 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:28,969 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:28,970 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:28,973 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:28,974 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:28,974 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_ALL"]
2015-02-11 00:44:28,974 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:28,974 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:28,974 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:28,975 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...mblyplatform/0_VALUES_ALL
2015-02-11 00:44:28,976 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:28,978 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:29,002 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:29,022 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:29,039 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local466745743_0032
2015-02-11 00:44:29,057 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity466745743/.staging/job_local466745743_0032/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:29,058 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity466745743/.staging/job_local466745743_0032/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:29,108 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local466745743_0032/job_local466745743_0032.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:29,109 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local466745743_0032/job_local466745743_0032.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:29,110 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:29,110 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local466745743_0032
2015-02-11 00:44:29,111 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:29,111 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:29,111 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:29,114 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:29,114 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local466745743_0032_m_000000_0
2015-02-11 00:44:29,115 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:29,116 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:29,117 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@547ab2e8
2015-02-11 00:44:29,118 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:29,118 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:29,143 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:29,143 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:29,143 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:29,144 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:29,144 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:29,145 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:29,145 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:29,151 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:29,151 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:29,154 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:29,154 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:29,154 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:29,155 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:29,155 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:29,158 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:29,159 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local466745743_0032_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:29,161 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:29,161 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local466745743_0032_m_000000_0' done.
2015-02-11 00:44:29,161 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local466745743_0032_m_000000_0
2015-02-11 00:44:29,162 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:29,162 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:29,162 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local466745743_0032_r_000000_0
2015-02-11 00:44:29,164 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:29,164 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@320b507a
2015-02-11 00:44:29,164 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552520896, maxSingleShuffleLimit=138130224, mergeThreshold=364663808, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:29,165 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local466745743_0032_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:29,167 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#32 about to shuffle output of map attempt_local466745743_0032_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:29,168 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local466745743_0032_m_000000_0
2015-02-11 00:44:29,168 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:29,170 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:29,171 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:29,171 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:29,173 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:29,174 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:29,176 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:29,176 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:29,176 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:29,176 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:29,177 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:29,177 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:29,178 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:29,178 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:29,183 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:29,183 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_ALL"]
2015-02-11 00:44:29,191 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-11 00:44:29,192 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:29,194 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local466745743_0032
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-11 00:44:29,194 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local466745743_0032 state at FAILED
2015-02-11 00:44:29,195 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-11 00:44:29,195 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-11 00:44:29,195 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-11 00:44:29,199 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-11 00:44:29,199 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...mblyplatform/0_VALUES_ALL
2015-02-11 00:44:29,200 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-11 00:44:29,200 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_ALL/_temporary
2015-02-11 00:44:29,200 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_VALUES_ALL
2015-02-11 00:44:29,217 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:29,218 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:29,223 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:29,225 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:29,226 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:29,229 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:29,230 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:29,230 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_REPLACE"]
2015-02-11 00:44:29,230 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:29,230 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:29,230 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:29,232 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...platform/0_VALUES_REPLACE
2015-02-11 00:44:29,233 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:29,234 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:29,259 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:29,279 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:29,295 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local688370361_0033
2015-02-11 00:44:29,312 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity688370361/.staging/job_local688370361_0033/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:29,313 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity688370361/.staging/job_local688370361_0033/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:29,361 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local688370361_0033/job_local688370361_0033.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:29,362 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local688370361_0033/job_local688370361_0033.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:29,363 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:29,363 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local688370361_0033
2015-02-11 00:44:29,363 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:29,363 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:29,364 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:29,366 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:29,366 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local688370361_0033_m_000000_0
2015-02-11 00:44:29,368 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:29,369 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:29,369 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@5bfd4a63
2015-02-11 00:44:29,370 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:29,371 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:29,397 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:29,397 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:29,397 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:29,397 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:29,397 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:29,399 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:29,399 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:29,404 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:29,404 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:29,407 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:29,407 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:29,407 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:29,408 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:29,408 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:29,411 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:29,413 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local688370361_0033_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:29,415 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:29,415 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local688370361_0033_m_000000_0' done.
2015-02-11 00:44:29,415 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local688370361_0033_m_000000_0
2015-02-11 00:44:29,415 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:29,416 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:29,416 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local688370361_0033_r_000000_0
2015-02-11 00:44:29,418 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:29,418 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@3e527586
2015-02-11 00:44:29,419 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552658496, maxSingleShuffleLimit=138164624, mergeThreshold=364754624, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:29,420 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local688370361_0033_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:29,421 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#33 about to shuffle output of map attempt_local688370361_0033_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:29,422 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local688370361_0033_m_000000_0
2015-02-11 00:44:29,422 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:29,423 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:29,424 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:29,424 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:29,426 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:29,426 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:29,428 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:29,428 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:29,428 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:29,428 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:29,429 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:29,429 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:29,429 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:29,430 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:29,434 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:29,434 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_REPLACE"]
2015-02-11 00:44:29,443 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-11 00:44:29,446 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:29,448 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local688370361_0033
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-11 00:44:29,458 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local688370361_0033 state at FAILED
2015-02-11 00:44:29,458 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-11 00:44:29,458 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-11 00:44:29,458 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-11 00:44:29,462 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-11 00:44:29,462 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...platform/0_VALUES_REPLACE
2015-02-11 00:44:29,463 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-11 00:44:29,463 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_REPLACE/_temporary
2015-02-11 00:44:29,464 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_VALUES_REPLACE
2015-02-11 00:44:29,480 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:29,481 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:29,486 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:29,488 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:29,488 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:29,492 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:29,492 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:29,493 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_SWAP"]
2015-02-11 00:44:29,493 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:29,493 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:29,493 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:29,494 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...blyplatform/0_VALUES_SWAP
2015-02-11 00:44:29,494 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:29,495 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:29,520 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:29,539 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:29,555 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local12292520_0034
2015-02-11 00:44:29,571 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity12292520/.staging/job_local12292520_0034/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:29,572 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity12292520/.staging/job_local12292520_0034/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:29,619 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local12292520_0034/job_local12292520_0034.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:29,621 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local12292520_0034/job_local12292520_0034.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:29,621 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:29,621 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local12292520_0034
2015-02-11 00:44:29,622 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:29,622 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:29,622 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:29,625 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:29,625 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local12292520_0034_m_000000_0
2015-02-11 00:44:29,627 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:29,628 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:29,628 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@5ca32803
2015-02-11 00:44:29,629 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:29,629 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:29,654 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:29,655 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:29,655 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:29,655 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:29,655 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:29,656 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:29,656 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:29,661 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:29,661 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:29,664 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:29,665 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:29,665 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:29,665 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:29,665 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:29,668 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:29,670 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local12292520_0034_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:29,672 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:29,672 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local12292520_0034_m_000000_0' done.
2015-02-11 00:44:29,672 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local12292520_0034_m_000000_0
2015-02-11 00:44:29,672 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:29,673 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:29,673 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local12292520_0034_r_000000_0
2015-02-11 00:44:29,674 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:29,675 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@1f2e930f
2015-02-11 00:44:29,675 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552475008, maxSingleShuffleLimit=138118752, mergeThreshold=364633504, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:29,676 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local12292520_0034_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:29,677 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#34 about to shuffle output of map attempt_local12292520_0034_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:29,678 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local12292520_0034_m_000000_0
2015-02-11 00:44:29,678 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:29,679 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:29,680 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:29,680 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:29,682 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:29,682 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:29,684 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:29,684 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:29,684 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:29,684 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:29,685 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:29,685 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:29,686 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:29,686 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:29,691 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:29,691 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_SWAP"]
2015-02-11 00:44:29,700 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-11 00:44:29,700 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:29,702 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local12292520_0034
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-11 00:44:29,705 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local12292520_0034 state at FAILED
2015-02-11 00:44:29,705 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-11 00:44:29,705 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-11 00:44:29,706 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-11 00:44:29,709 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-11 00:44:29,710 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...blyplatform/0_VALUES_SWAP
2015-02-11 00:44:29,710 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-11 00:44:29,711 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_SWAP/_temporary
2015-02-11 00:44:29,711 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_VALUES_SWAP
2015-02-11 00:44:29,728 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:29,728 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:29,734 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:29,736 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:29,736 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:29,739 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:29,740 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:29,740 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_-1"]
2015-02-11 00:44:29,740 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:29,740 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:29,740 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:29,741 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...ssemblyplatform/0_ARGS_-1
2015-02-11 00:44:29,742 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:29,742 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:29,767 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:29,785 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:29,801 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1062374657_0035
2015-02-11 00:44:29,817 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1062374657/.staging/job_local1062374657_0035/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:29,818 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1062374657/.staging/job_local1062374657_0035/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:29,865 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1062374657_0035/job_local1062374657_0035.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:29,866 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1062374657_0035/job_local1062374657_0035.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:29,867 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:29,867 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1062374657_0035
2015-02-11 00:44:29,867 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:29,867 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:29,868 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:29,870 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:29,870 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1062374657_0035_m_000000_0
2015-02-11 00:44:29,872 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:29,873 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:29,873 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@6fe90d95
2015-02-11 00:44:29,874 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:29,875 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:29,902 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:29,902 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:29,902 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:29,902 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:29,902 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:29,903 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:29,904 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:29,909 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:29,909 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:29,913 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:29,913 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:29,913 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:29,914 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:29,914 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:29,917 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:29,919 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1062374657_0035_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:29,921 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:29,921 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1062374657_0035_m_000000_0' done.
2015-02-11 00:44:29,922 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1062374657_0035_m_000000_0
2015-02-11 00:44:29,922 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:29,923 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:29,923 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1062374657_0035_r_000000_0
2015-02-11 00:44:29,924 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:29,925 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@61d22f35
2015-02-11 00:44:29,926 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552153920, maxSingleShuffleLimit=138038480, mergeThreshold=364421600, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:29,927 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1062374657_0035_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:29,928 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#35 about to shuffle output of map attempt_local1062374657_0035_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:29,929 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1062374657_0035_m_000000_0
2015-02-11 00:44:29,929 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:29,930 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:29,931 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:29,931 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:29,933 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:29,934 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:29,935 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:29,936 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:29,936 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:29,937 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:29,937 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:29,938 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:29,938 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:29,939 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:29,943 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:29,944 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_-1"]
2015-02-11 00:44:29,956 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1062374657_0035_r_000000_0 is done. And is in the process of committing
2015-02-11 00:44:29,957 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:29,958 INFO  mapred.Task (Task.java:commit(1162)) - Task attempt_local1062374657_0035_r_000000_0 is allowed to commit now
2015-02-11 00:44:29,959 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1062374657_0035_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_-1/_temporary/0/task_local1062374657_0035_r_000000
2015-02-11 00:44:29,960 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:29,960 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1062374657_0035_r_000000_0' done.
2015-02-11 00:44:29,960 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1062374657_0035_r_000000_0
2015-02-11 00:44:29,961 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:29,978 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_-1/_temporary
2015-02-11 00:44:30,008 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:30,039 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:30,040 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_ARGS_-1
2015-02-11 00:44:30,058 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:30,058 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:30,062 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_ARGS_'field'
2015-02-11 00:44:30,079 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:30,079 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:30,085 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:30,087 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:30,087 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:30,091 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:30,091 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:30,091 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_RESULTS"]
2015-02-11 00:44:30,092 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:30,092 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:30,092 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:30,093 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...lyplatform/0_ARGS_RESULTS
2015-02-11 00:44:30,094 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:30,095 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:30,119 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:30,138 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:30,154 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1814968239_0036
2015-02-11 00:44:30,172 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1814968239/.staging/job_local1814968239_0036/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:30,173 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1814968239/.staging/job_local1814968239_0036/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:30,221 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1814968239_0036/job_local1814968239_0036.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:30,222 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1814968239_0036/job_local1814968239_0036.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:30,222 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:30,223 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:30,223 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:30,223 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1814968239_0036
2015-02-11 00:44:30,224 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:30,226 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:30,226 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1814968239_0036_m_000000_0
2015-02-11 00:44:30,227 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:30,228 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:30,229 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@1c3627d1
2015-02-11 00:44:30,230 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:30,230 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:30,255 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:30,256 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:30,256 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:30,256 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:30,256 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:30,258 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:30,258 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:30,263 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:30,263 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:30,267 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:30,267 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:30,267 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:30,268 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:30,268 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:30,271 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:30,273 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1814968239_0036_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:30,275 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:30,275 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1814968239_0036_m_000000_0' done.
2015-02-11 00:44:30,275 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1814968239_0036_m_000000_0
2015-02-11 00:44:30,276 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:30,276 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:30,277 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1814968239_0036_r_000000_0
2015-02-11 00:44:30,278 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:30,278 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@1552dc6d
2015-02-11 00:44:30,279 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552383296, maxSingleShuffleLimit=138095824, mergeThreshold=364572992, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:30,280 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1814968239_0036_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:30,281 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#36 about to shuffle output of map attempt_local1814968239_0036_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:30,282 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1814968239_0036_m_000000_0
2015-02-11 00:44:30,282 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:30,283 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:30,284 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:30,285 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:30,287 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:30,287 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:30,289 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:30,289 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:30,290 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:30,290 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:30,290 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:30,291 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:30,292 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:30,292 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:30,296 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:30,297 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_RESULTS"]
2015-02-11 00:44:30,309 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1814968239_0036_r_000000_0 is done. And is in the process of committing
2015-02-11 00:44:30,310 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:30,310 INFO  mapred.Task (Task.java:commit(1162)) - Task attempt_local1814968239_0036_r_000000_0 is allowed to commit now
2015-02-11 00:44:30,311 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1814968239_0036_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_RESULTS/_temporary/0/task_local1814968239_0036_r_000000
2015-02-11 00:44:30,312 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:30,312 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1814968239_0036_r_000000_0' done.
2015-02-11 00:44:30,312 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1814968239_0036_r_000000_0
2015-02-11 00:44:30,312 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:30,332 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_RESULTS/_temporary
2015-02-11 00:44:30,361 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:30,392 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:30,393 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_ARGS_RESULTS
2015-02-11 00:44:30,409 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:30,410 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:30,414 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_ARGS_ALL
2015-02-11 00:44:30,430 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:30,430 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:30,436 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:30,438 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:30,438 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:30,442 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:30,442 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:30,442 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_REPLACE"]
2015-02-11 00:44:30,443 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:30,443 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:30,443 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:30,443 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...lyplatform/0_ARGS_REPLACE
2015-02-11 00:44:30,444 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:30,445 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:30,469 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:30,488 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:30,504 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1883320323_0037
2015-02-11 00:44:30,521 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1883320323/.staging/job_local1883320323_0037/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:30,522 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1883320323/.staging/job_local1883320323_0037/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:30,568 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1883320323_0037/job_local1883320323_0037.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:30,570 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1883320323_0037/job_local1883320323_0037.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:30,570 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:30,571 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:30,571 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1883320323_0037
2015-02-11 00:44:30,571 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:30,571 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:30,574 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:30,574 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1883320323_0037_m_000000_0
2015-02-11 00:44:30,575 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:30,577 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:30,577 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@37fe883b
2015-02-11 00:44:30,578 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:30,578 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:30,605 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:30,605 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:30,605 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:30,605 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:30,605 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:30,607 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:30,607 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:30,611 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:30,612 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:30,615 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:30,615 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:30,615 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:30,615 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:30,615 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:30,619 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:30,621 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1883320323_0037_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:30,622 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:30,622 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1883320323_0037_m_000000_0' done.
2015-02-11 00:44:30,623 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1883320323_0037_m_000000_0
2015-02-11 00:44:30,623 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:30,623 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:30,623 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1883320323_0037_r_000000_0
2015-02-11 00:44:30,625 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:30,625 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@3f8a0ef0
2015-02-11 00:44:30,626 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=551603392, maxSingleShuffleLimit=137900848, mergeThreshold=364058240, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:30,626 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1883320323_0037_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:30,628 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#37 about to shuffle output of map attempt_local1883320323_0037_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:30,629 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1883320323_0037_m_000000_0
2015-02-11 00:44:30,629 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:30,630 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:30,631 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:30,631 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:30,633 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:30,633 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:30,635 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:30,635 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:30,635 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:30,635 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:30,636 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:30,636 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:30,637 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:30,637 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:30,641 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:30,641 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_REPLACE"]
2015-02-11 00:44:30,653 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1883320323_0037_r_000000_0 is done. And is in the process of committing
2015-02-11 00:44:30,654 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:30,654 INFO  mapred.Task (Task.java:commit(1162)) - Task attempt_local1883320323_0037_r_000000_0 is allowed to commit now
2015-02-11 00:44:30,655 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1883320323_0037_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_REPLACE/_temporary/0/task_local1883320323_0037_r_000000
2015-02-11 00:44:30,656 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:30,656 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1883320323_0037_r_000000_0' done.
2015-02-11 00:44:30,656 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1883320323_0037_r_000000_0
2015-02-11 00:44:30,656 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:30,669 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_REPLACE/_temporary
2015-02-11 00:44:30,699 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:30,729 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:30,731 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_ARGS_REPLACE
2015-02-11 00:44:30,748 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:30,748 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:30,753 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:30,755 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:30,755 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:30,759 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:30,759 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:30,759 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_SWAP"]
2015-02-11 00:44:30,759 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:30,759 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:30,760 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:30,760 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...emblyplatform/0_ARGS_SWAP
2015-02-11 00:44:30,761 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:30,762 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:30,787 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:30,805 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:30,821 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local591557197_0038
2015-02-11 00:44:30,838 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity591557197/.staging/job_local591557197_0038/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:30,839 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity591557197/.staging/job_local591557197_0038/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:30,886 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local591557197_0038/job_local591557197_0038.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:30,887 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local591557197_0038/job_local591557197_0038.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:30,887 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:30,888 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local591557197_0038
2015-02-11 00:44:30,888 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:30,888 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:30,888 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:30,892 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:30,892 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local591557197_0038_m_000000_0
2015-02-11 00:44:30,894 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:30,895 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:30,896 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@4435db24
2015-02-11 00:44:30,898 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:30,898 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:30,924 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:30,925 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:30,925 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:30,925 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:30,925 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:30,926 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:30,926 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:30,932 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:30,932 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:30,935 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:30,935 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:30,935 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:30,935 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:30,936 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:30,939 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:30,941 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local591557197_0038_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:30,943 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:30,943 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local591557197_0038_m_000000_0' done.
2015-02-11 00:44:30,943 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local591557197_0038_m_000000_0
2015-02-11 00:44:30,943 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:30,944 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:30,944 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local591557197_0038_r_000000_0
2015-02-11 00:44:30,945 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:30,945 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@375b4535
2015-02-11 00:44:30,946 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552291520, maxSingleShuffleLimit=138072880, mergeThreshold=364512416, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:30,947 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local591557197_0038_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:30,948 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#38 about to shuffle output of map attempt_local591557197_0038_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:30,949 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local591557197_0038_m_000000_0
2015-02-11 00:44:30,949 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:30,950 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:30,951 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:30,951 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:30,956 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:30,956 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:30,957 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:30,958 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:30,958 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:30,958 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:30,959 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:30,959 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:30,960 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:30,960 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:30,964 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:30,964 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_SWAP"]
2015-02-11 00:44:30,976 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local591557197_0038_r_000000_0 is done. And is in the process of committing
2015-02-11 00:44:30,977 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:30,977 INFO  mapred.Task (Task.java:commit(1162)) - Task attempt_local591557197_0038_r_000000_0 is allowed to commit now
2015-02-11 00:44:30,978 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local591557197_0038_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_SWAP/_temporary/0/task_local591557197_0038_r_000000
2015-02-11 00:44:30,979 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:30,979 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local591557197_0038_r_000000_0' done.
2015-02-11 00:44:30,979 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local591557197_0038_r_000000_0
2015-02-11 00:44:30,979 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:30,999 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_SWAP/_temporary
2015-02-11 00:44:31,028 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:31,059 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:31,060 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_ARGS_SWAP
2015-02-11 00:44:31,077 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:31,077 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:31,082 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:31,084 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:31,084 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:31,088 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:31,088 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:31,088 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_-1"]
2015-02-11 00:44:31,088 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:31,089 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:31,089 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:31,090 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...lyplatform/ALL_'field'_-1
2015-02-11 00:44:31,090 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:31,091 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:31,115 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:31,134 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:31,150 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local272699242_0039
2015-02-11 00:44:31,167 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity272699242/.staging/job_local272699242_0039/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:31,169 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity272699242/.staging/job_local272699242_0039/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:31,218 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local272699242_0039/job_local272699242_0039.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:31,219 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local272699242_0039/job_local272699242_0039.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:31,220 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:31,220 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local272699242_0039
2015-02-11 00:44:31,221 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:31,221 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:31,221 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:31,224 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:31,224 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local272699242_0039_m_000000_0
2015-02-11 00:44:31,225 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:31,226 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:31,227 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@189fab56
2015-02-11 00:44:31,228 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:31,228 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:31,255 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:31,255 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:31,255 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:31,255 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:31,255 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:31,256 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:31,257 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:31,261 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:31,262 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:31,268 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:31,268 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:31,268 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:31,269 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:31,269 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:31,272 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:31,274 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local272699242_0039_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:31,276 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:31,276 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local272699242_0039_m_000000_0' done.
2015-02-11 00:44:31,276 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local272699242_0039_m_000000_0
2015-02-11 00:44:31,276 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:31,277 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:31,277 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local272699242_0039_r_000000_0
2015-02-11 00:44:31,278 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:31,278 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@4aa0a82c
2015-02-11 00:44:31,279 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552337408, maxSingleShuffleLimit=138084352, mergeThreshold=364542688, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:31,280 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local272699242_0039_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:31,281 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#39 about to shuffle output of map attempt_local272699242_0039_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:31,282 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local272699242_0039_m_000000_0
2015-02-11 00:44:31,282 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:31,283 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:31,284 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:31,284 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:31,286 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:31,287 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:31,288 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:31,290 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:31,291 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:31,291 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:31,291 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:31,292 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:31,292 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:31,293 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:31,297 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:31,297 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_-1"]
2015-02-11 00:44:31,309 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local272699242_0039_r_000000_0 is done. And is in the process of committing
2015-02-11 00:44:31,310 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:31,311 INFO  mapred.Task (Task.java:commit(1162)) - Task attempt_local272699242_0039_r_000000_0 is allowed to commit now
2015-02-11 00:44:31,311 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local272699242_0039_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_-1/_temporary/0/task_local272699242_0039_r_000000
2015-02-11 00:44:31,313 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:31,313 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local272699242_0039_r_000000_0' done.
2015-02-11 00:44:31,313 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local272699242_0039_r_000000_0
2015-02-11 00:44:31,314 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:31,329 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_-1/_temporary
2015-02-11 00:44:31,358 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:31,388 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:31,390 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_-1
2015-02-11 00:44:31,406 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:31,406 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:31,411 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:31,413 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:31,414 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:31,417 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:31,417 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:31,417 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_'field'"]
2015-02-11 00:44:31,418 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:31,418 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:31,418 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:31,418 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...tform/ALL_'field'_'field'
2015-02-11 00:44:31,419 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:31,420 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:31,444 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:31,461 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:31,478 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1261063359_0040
2015-02-11 00:44:31,496 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1261063359/.staging/job_local1261063359_0040/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:31,497 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1261063359/.staging/job_local1261063359_0040/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:31,547 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1261063359_0040/job_local1261063359_0040.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:31,549 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1261063359_0040/job_local1261063359_0040.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:31,549 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:31,550 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1261063359_0040
2015-02-11 00:44:31,550 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:31,550 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:31,550 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:31,553 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:31,553 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1261063359_0040_m_000000_0
2015-02-11 00:44:31,555 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:31,556 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:31,556 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@18329bfc
2015-02-11 00:44:31,557 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:31,557 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:31,583 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:31,584 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:31,584 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:31,584 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:31,584 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:31,585 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:31,585 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:31,589 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:31,589 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:31,593 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:31,593 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:31,593 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:31,593 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:31,593 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:31,596 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:31,598 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1261063359_0040_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:31,600 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:31,600 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1261063359_0040_m_000000_0' done.
2015-02-11 00:44:31,600 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1261063359_0040_m_000000_0
2015-02-11 00:44:31,600 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:31,601 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:31,601 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1261063359_0040_r_000000_0
2015-02-11 00:44:31,603 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:31,603 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@18933ab5
2015-02-11 00:44:31,604 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552337408, maxSingleShuffleLimit=138084352, mergeThreshold=364542688, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:31,605 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1261063359_0040_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:31,607 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#40 about to shuffle output of map attempt_local1261063359_0040_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:31,608 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1261063359_0040_m_000000_0
2015-02-11 00:44:31,608 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:31,608 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:31,609 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:31,610 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:31,611 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:31,612 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:31,614 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:31,614 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:31,614 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:31,615 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:31,615 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:31,616 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:31,616 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:31,617 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:31,621 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:31,621 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_'field'"]
2015-02-11 00:44:31,633 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1261063359_0040_r_000000_0 is done. And is in the process of committing
2015-02-11 00:44:31,634 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:31,635 INFO  mapred.Task (Task.java:commit(1162)) - Task attempt_local1261063359_0040_r_000000_0 is allowed to commit now
2015-02-11 00:44:31,635 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1261063359_0040_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_'field'/_temporary/0/task_local1261063359_0040_r_000000
2015-02-11 00:44:31,637 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:31,637 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1261063359_0040_r_000000_0' done.
2015-02-11 00:44:31,637 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1261063359_0040_r_000000_0
2015-02-11 00:44:31,638 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:31,659 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_'field'/_temporary
2015-02-11 00:44:31,688 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:31,719 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:31,720 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_'field'
2015-02-11 00:44:31,737 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:31,737 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:31,742 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:31,744 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:31,745 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:31,748 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:31,749 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:31,750 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_RESULTS"]
2015-02-11 00:44:31,750 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:31,751 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:31,751 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:31,752 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...tform/ALL_'field'_RESULTS
2015-02-11 00:44:31,753 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:31,754 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:31,778 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:31,797 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:31,812 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local298868279_0041
2015-02-11 00:44:31,830 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity298868279/.staging/job_local298868279_0041/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:31,831 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity298868279/.staging/job_local298868279_0041/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:31,878 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local298868279_0041/job_local298868279_0041.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:31,880 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local298868279_0041/job_local298868279_0041.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:31,881 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:31,881 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:31,881 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:31,881 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local298868279_0041
2015-02-11 00:44:31,882 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:31,883 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:31,884 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local298868279_0041_m_000000_0
2015-02-11 00:44:31,885 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:31,886 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:31,887 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@783096a1
2015-02-11 00:44:31,888 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:31,888 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:31,914 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:31,915 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:31,915 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:31,915 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:31,915 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:31,916 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:31,916 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:31,923 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:31,923 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:31,927 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:31,927 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:31,927 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:31,928 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:31,928 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:31,931 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:31,933 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local298868279_0041_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:31,935 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:31,936 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local298868279_0041_m_000000_0' done.
2015-02-11 00:44:31,936 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local298868279_0041_m_000000_0
2015-02-11 00:44:31,936 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:31,937 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:31,937 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local298868279_0041_r_000000_0
2015-02-11 00:44:31,939 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:31,939 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@431ab23
2015-02-11 00:44:31,939 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552337408, maxSingleShuffleLimit=138084352, mergeThreshold=364542688, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:31,940 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local298868279_0041_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:31,941 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#41 about to shuffle output of map attempt_local298868279_0041_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:31,942 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local298868279_0041_m_000000_0
2015-02-11 00:44:31,942 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:31,942 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:31,943 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:31,943 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:31,947 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:31,947 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:31,949 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:31,950 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:31,950 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:31,950 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:31,951 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:31,951 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:31,952 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:31,952 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:31,956 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:31,956 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_RESULTS"]
2015-02-11 00:44:31,967 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local298868279_0041_r_000000_0 is done. And is in the process of committing
2015-02-11 00:44:31,968 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:31,969 INFO  mapred.Task (Task.java:commit(1162)) - Task attempt_local298868279_0041_r_000000_0 is allowed to commit now
2015-02-11 00:44:31,969 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local298868279_0041_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_RESULTS/_temporary/0/task_local298868279_0041_r_000000
2015-02-11 00:44:31,970 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:31,970 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local298868279_0041_r_000000_0' done.
2015-02-11 00:44:31,971 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local298868279_0041_r_000000_0
2015-02-11 00:44:31,971 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:31,990 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_RESULTS/_temporary
2015-02-11 00:44:32,019 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:32,049 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:32,051 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_RESULTS
2015-02-11 00:44:32,068 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:32,068 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:32,073 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:32,075 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:32,076 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:32,079 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:32,079 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:32,079 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_ALL"]
2015-02-11 00:44:32,080 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:32,080 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:32,080 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:32,081 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...yplatform/ALL_'field'_ALL
2015-02-11 00:44:32,081 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:32,082 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:32,107 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:32,126 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:32,142 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1969565347_0042
2015-02-11 00:44:32,158 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1969565347/.staging/job_local1969565347_0042/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:32,159 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1969565347/.staging/job_local1969565347_0042/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:32,206 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1969565347_0042/job_local1969565347_0042.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:32,208 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1969565347_0042/job_local1969565347_0042.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:32,208 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:32,208 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1969565347_0042
2015-02-11 00:44:32,208 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:32,209 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:32,209 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:32,212 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:32,212 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1969565347_0042_m_000000_0
2015-02-11 00:44:32,213 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:32,215 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:32,215 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@3a67cc93
2015-02-11 00:44:32,216 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:32,216 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:32,242 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:32,242 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:32,242 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:32,242 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:32,242 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:32,243 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:32,243 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:32,249 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:32,249 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:32,252 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:32,252 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:32,252 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:32,252 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:32,252 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:32,255 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:32,257 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1969565347_0042_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:32,258 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:32,259 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1969565347_0042_m_000000_0' done.
2015-02-11 00:44:32,259 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1969565347_0042_m_000000_0
2015-02-11 00:44:32,259 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:32,260 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:32,260 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1969565347_0042_r_000000_0
2015-02-11 00:44:32,261 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:32,261 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@4fa6cb2d
2015-02-11 00:44:32,262 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552245632, maxSingleShuffleLimit=138061408, mergeThreshold=364482144, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:32,263 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1969565347_0042_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:32,264 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#42 about to shuffle output of map attempt_local1969565347_0042_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:32,264 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1969565347_0042_m_000000_0
2015-02-11 00:44:32,264 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:32,265 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:32,266 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:32,266 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:32,268 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:32,268 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:32,269 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:32,270 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:32,270 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:32,271 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:32,271 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:32,272 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:32,272 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:32,272 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:32,278 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:32,278 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_ALL"]
2015-02-11 00:44:32,291 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1969565347_0042_r_000000_0 is done. And is in the process of committing
2015-02-11 00:44:32,293 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:32,293 INFO  mapred.Task (Task.java:commit(1162)) - Task attempt_local1969565347_0042_r_000000_0 is allowed to commit now
2015-02-11 00:44:32,293 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1969565347_0042_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_ALL/_temporary/0/task_local1969565347_0042_r_000000
2015-02-11 00:44:32,295 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:32,295 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1969565347_0042_r_000000_0' done.
2015-02-11 00:44:32,295 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1969565347_0042_r_000000_0
2015-02-11 00:44:32,295 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:32,317 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_ALL/_temporary
2015-02-11 00:44:32,346 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:32,375 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:32,377 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_ALL
2015-02-11 00:44:32,395 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:32,396 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:32,400 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_REPLACE
2015-02-11 00:44:32,416 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:32,417 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:32,422 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:32,424 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:32,424 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:32,428 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:32,428 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:32,428 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_SWAP"]
2015-02-11 00:44:32,428 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:32,428 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:32,428 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:32,429 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...platform/ALL_'field'_SWAP
2015-02-11 00:44:32,430 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:32,430 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:32,458 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:32,480 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:32,498 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local2019033118_0043
2015-02-11 00:44:32,516 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity2019033118/.staging/job_local2019033118_0043/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:32,517 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity2019033118/.staging/job_local2019033118_0043/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:32,568 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2019033118_0043/job_local2019033118_0043.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:32,569 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2019033118_0043/job_local2019033118_0043.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:32,569 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:32,570 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local2019033118_0043
2015-02-11 00:44:32,570 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:32,570 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:32,570 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:32,572 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:32,573 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local2019033118_0043_m_000000_0
2015-02-11 00:44:32,574 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:32,575 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:32,575 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@49a8422e
2015-02-11 00:44:32,576 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:32,576 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:32,602 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:32,603 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:32,603 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:32,603 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:32,603 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:32,604 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:32,605 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:32,609 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:32,609 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:32,612 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:32,612 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:32,613 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:32,613 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:32,613 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:32,617 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:32,619 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local2019033118_0043_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:32,620 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:32,621 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local2019033118_0043_m_000000_0' done.
2015-02-11 00:44:32,621 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local2019033118_0043_m_000000_0
2015-02-11 00:44:32,621 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:32,622 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:32,622 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local2019033118_0043_r_000000_0
2015-02-11 00:44:32,623 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:32,623 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@49cf882
2015-02-11 00:44:32,624 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552291520, maxSingleShuffleLimit=138072880, mergeThreshold=364512416, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:32,624 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local2019033118_0043_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:32,625 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#43 about to shuffle output of map attempt_local2019033118_0043_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:32,626 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local2019033118_0043_m_000000_0
2015-02-11 00:44:32,626 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:32,626 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:32,627 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:32,628 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:32,629 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:32,630 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:32,631 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:32,631 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:32,632 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:32,632 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:32,632 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:32,633 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:32,633 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:32,633 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:32,637 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:32,638 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_SWAP"]
2015-02-11 00:44:32,650 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local2019033118_0043_r_000000_0 is done. And is in the process of committing
2015-02-11 00:44:32,651 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:32,652 INFO  mapred.Task (Task.java:commit(1162)) - Task attempt_local2019033118_0043_r_000000_0 is allowed to commit now
2015-02-11 00:44:32,652 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local2019033118_0043_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_SWAP/_temporary/0/task_local2019033118_0043_r_000000
2015-02-11 00:44:32,653 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:32,653 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local2019033118_0043_r_000000_0' done.
2015-02-11 00:44:32,654 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local2019033118_0043_r_000000_0
2015-02-11 00:44:32,654 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:32,668 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_SWAP/_temporary
2015-02-11 00:44:32,698 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:32,728 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:32,730 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_SWAP
2015-02-11 00:44:32,747 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:32,748 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:32,753 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:32,755 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:32,755 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:32,758 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:32,758 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:32,759 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_-1"]
2015-02-11 00:44:32,759 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:32,759 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:32,759 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:32,760 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...lyplatform/ALL_UNKNOWN_-1
2015-02-11 00:44:32,761 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:32,762 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:32,787 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:32,805 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:32,822 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1197757947_0044
2015-02-11 00:44:32,839 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1197757947/.staging/job_local1197757947_0044/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:32,841 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1197757947/.staging/job_local1197757947_0044/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:32,892 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1197757947_0044/job_local1197757947_0044.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:32,893 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1197757947_0044/job_local1197757947_0044.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:32,895 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:32,895 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:32,895 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:32,895 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1197757947_0044
2015-02-11 00:44:32,896 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:32,897 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:32,898 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1197757947_0044_m_000000_0
2015-02-11 00:44:32,899 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:32,900 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:32,900 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@6f1ba9df
2015-02-11 00:44:32,901 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:32,902 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:32,927 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:32,927 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:32,928 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:32,928 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:32,928 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:32,929 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:32,929 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:32,932 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:32,933 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:32,935 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:32,936 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:32,936 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:32,936 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:32,936 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:32,941 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:32,943 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1197757947_0044_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:32,944 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:32,944 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1197757947_0044_m_000000_0' done.
2015-02-11 00:44:32,945 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1197757947_0044_m_000000_0
2015-02-11 00:44:32,945 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:32,945 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:32,946 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1197757947_0044_r_000000_0
2015-02-11 00:44:32,947 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:32,947 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@4dfbbcea
2015-02-11 00:44:32,948 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552291520, maxSingleShuffleLimit=138072880, mergeThreshold=364512416, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:32,948 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1197757947_0044_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:32,949 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#44 about to shuffle output of map attempt_local1197757947_0044_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:32,950 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1197757947_0044_m_000000_0
2015-02-11 00:44:32,950 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:32,950 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:32,951 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:32,951 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:32,953 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:32,953 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:32,955 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:32,955 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:32,956 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:32,956 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:32,956 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:32,957 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:32,958 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:32,958 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:32,962 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:32,963 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_-1"]
2015-02-11 00:44:32,975 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1197757947_0044_r_000000_0 is done. And is in the process of committing
2015-02-11 00:44:32,976 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:32,976 INFO  mapred.Task (Task.java:commit(1162)) - Task attempt_local1197757947_0044_r_000000_0 is allowed to commit now
2015-02-11 00:44:32,977 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1197757947_0044_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_-1/_temporary/0/task_local1197757947_0044_r_000000
2015-02-11 00:44:32,978 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:32,978 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1197757947_0044_r_000000_0' done.
2015-02-11 00:44:32,978 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1197757947_0044_r_000000_0
2015-02-11 00:44:32,978 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:32,992 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_-1/_temporary
2015-02-11 00:44:33,021 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:33,081 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:33,083 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_-1
2015-02-11 00:44:33,100 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:33,101 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:33,105 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_'field'
2015-02-11 00:44:33,122 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:33,124 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:33,129 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:33,131 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:33,132 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:33,136 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:33,136 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:33,136 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_RESULTS"]
2015-02-11 00:44:33,136 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:33,136 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:33,137 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:33,137 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...tform/ALL_UNKNOWN_RESULTS
2015-02-11 00:44:33,138 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:33,139 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:33,165 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:33,185 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:33,203 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local160289479_0045
2015-02-11 00:44:33,219 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity160289479/.staging/job_local160289479_0045/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:33,221 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity160289479/.staging/job_local160289479_0045/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:33,269 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local160289479_0045/job_local160289479_0045.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:33,270 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local160289479_0045/job_local160289479_0045.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:33,271 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:33,271 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local160289479_0045
2015-02-11 00:44:33,271 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:33,271 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:33,272 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:33,274 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:33,274 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local160289479_0045_m_000000_0
2015-02-11 00:44:33,276 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:33,277 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:33,278 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@216b58fa
2015-02-11 00:44:33,279 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:33,279 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:33,305 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:33,306 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:33,306 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:33,307 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:33,307 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:33,310 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:33,310 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:33,314 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:33,314 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:33,317 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:33,318 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:33,318 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:33,318 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:33,318 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:33,321 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:33,323 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local160289479_0045_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:33,324 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:33,325 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local160289479_0045_m_000000_0' done.
2015-02-11 00:44:33,325 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local160289479_0045_m_000000_0
2015-02-11 00:44:33,325 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:33,325 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:33,326 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local160289479_0045_r_000000_0
2015-02-11 00:44:33,327 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:33,327 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@51a34231
2015-02-11 00:44:33,328 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552337408, maxSingleShuffleLimit=138084352, mergeThreshold=364542688, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:33,328 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local160289479_0045_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:33,329 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#45 about to shuffle output of map attempt_local160289479_0045_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:33,330 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local160289479_0045_m_000000_0
2015-02-11 00:44:33,330 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:33,331 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:33,331 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:33,332 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:33,335 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:33,335 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:33,337 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:33,337 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:33,337 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:33,337 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:33,338 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:33,338 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:33,339 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:33,339 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:33,342 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:33,342 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_RESULTS"]
2015-02-11 00:44:33,355 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local160289479_0045_r_000000_0 is done. And is in the process of committing
2015-02-11 00:44:33,356 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:33,356 INFO  mapred.Task (Task.java:commit(1162)) - Task attempt_local160289479_0045_r_000000_0 is allowed to commit now
2015-02-11 00:44:33,357 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local160289479_0045_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_RESULTS/_temporary/0/task_local160289479_0045_r_000000
2015-02-11 00:44:33,358 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:33,358 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local160289479_0045_r_000000_0' done.
2015-02-11 00:44:33,358 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local160289479_0045_r_000000_0
2015-02-11 00:44:33,359 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:33,380 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_RESULTS/_temporary
2015-02-11 00:44:33,410 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:33,440 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:33,442 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_RESULTS
2015-02-11 00:44:33,458 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:33,458 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:33,463 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:33,465 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:33,465 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:33,468 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:33,469 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:33,469 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_ALL"]
2015-02-11 00:44:33,469 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:33,469 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:33,469 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:33,469 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...yplatform/ALL_UNKNOWN_ALL
2015-02-11 00:44:33,470 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:33,471 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:33,495 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:33,514 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:33,530 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1758534456_0046
2015-02-11 00:44:33,547 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1758534456/.staging/job_local1758534456_0046/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:33,549 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1758534456/.staging/job_local1758534456_0046/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:33,597 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1758534456_0046/job_local1758534456_0046.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:33,599 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1758534456_0046/job_local1758534456_0046.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:33,599 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:33,600 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1758534456_0046
2015-02-11 00:44:33,600 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:33,600 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:33,600 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:33,602 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:33,602 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1758534456_0046_m_000000_0
2015-02-11 00:44:33,604 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:33,605 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:33,605 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@2452a793
2015-02-11 00:44:33,606 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:33,606 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:33,632 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:33,632 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:33,632 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:33,632 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:33,632 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:33,633 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:33,634 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:33,637 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:33,637 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:33,640 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:33,640 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:33,641 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:33,641 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:33,641 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:33,644 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:33,646 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1758534456_0046_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:33,648 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:33,648 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1758534456_0046_m_000000_0' done.
2015-02-11 00:44:33,648 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1758534456_0046_m_000000_0
2015-02-11 00:44:33,649 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:33,649 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:33,650 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1758534456_0046_r_000000_0
2015-02-11 00:44:33,651 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:33,651 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@1e1e306f
2015-02-11 00:44:33,652 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552245632, maxSingleShuffleLimit=138061408, mergeThreshold=364482144, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:33,653 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1758534456_0046_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:33,654 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#46 about to shuffle output of map attempt_local1758534456_0046_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:33,654 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1758534456_0046_m_000000_0
2015-02-11 00:44:33,655 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:33,655 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:33,656 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:33,656 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:33,658 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:33,658 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:33,660 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:33,660 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:33,660 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:33,661 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:33,661 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:33,662 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:33,662 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:33,663 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:33,666 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:33,666 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_ALL"]
2015-02-11 00:44:33,678 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1758534456_0046_r_000000_0 is done. And is in the process of committing
2015-02-11 00:44:33,679 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:33,679 INFO  mapred.Task (Task.java:commit(1162)) - Task attempt_local1758534456_0046_r_000000_0 is allowed to commit now
2015-02-11 00:44:33,680 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1758534456_0046_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_ALL/_temporary/0/task_local1758534456_0046_r_000000
2015-02-11 00:44:33,681 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:33,682 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1758534456_0046_r_000000_0' done.
2015-02-11 00:44:33,682 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1758534456_0046_r_000000_0
2015-02-11 00:44:33,682 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:33,700 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_ALL/_temporary
2015-02-11 00:44:33,729 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:33,764 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:33,765 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_ALL
2015-02-11 00:44:33,782 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:33,783 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:33,788 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:33,790 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:33,791 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:33,794 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:33,794 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:33,794 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_REPLACE"]
2015-02-11 00:44:33,794 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:33,794 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:33,794 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:33,795 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...tform/ALL_UNKNOWN_REPLACE
2015-02-11 00:44:33,795 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:33,796 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:33,820 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:33,839 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:33,855 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local649760096_0047
2015-02-11 00:44:33,872 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity649760096/.staging/job_local649760096_0047/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:33,873 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity649760096/.staging/job_local649760096_0047/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:33,920 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local649760096_0047/job_local649760096_0047.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:33,922 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local649760096_0047/job_local649760096_0047.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:33,923 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:33,923 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:33,924 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:33,923 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local649760096_0047
2015-02-11 00:44:33,924 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:33,926 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:33,926 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local649760096_0047_m_000000_0
2015-02-11 00:44:33,928 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:33,929 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:33,930 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@578ef2b6
2015-02-11 00:44:33,931 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:33,931 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:33,956 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:33,957 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:33,957 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:33,957 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:33,957 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:33,959 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:33,959 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:33,962 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:33,963 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:33,965 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:33,965 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:33,966 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:33,966 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:33,966 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:33,969 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:33,971 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local649760096_0047_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:33,973 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:33,974 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local649760096_0047_m_000000_0' done.
2015-02-11 00:44:33,974 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:33,974 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local649760096_0047_m_000000_0
2015-02-11 00:44:33,974 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:33,975 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:33,975 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local649760096_0047_r_000000_0
2015-02-11 00:44:33,976 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:33,977 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@c1b548a
2015-02-11 00:44:33,978 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552337408, maxSingleShuffleLimit=138084352, mergeThreshold=364542688, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:33,979 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local649760096_0047_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:33,980 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#47 about to shuffle output of map attempt_local649760096_0047_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:33,980 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local649760096_0047_m_000000_0
2015-02-11 00:44:33,981 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:33,981 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:33,982 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:33,983 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:33,986 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:33,986 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:33,989 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:33,989 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:33,989 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:33,989 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:33,990 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:33,991 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:33,991 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:33,991 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:33,995 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:33,996 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_REPLACE"]
2015-02-11 00:44:34,004 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-11 00:44:34,005 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:34,007 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local649760096_0047
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-11 00:44:34,011 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local649760096_0047 state at FAILED
2015-02-11 00:44:34,011 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-11 00:44:34,011 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-11 00:44:34,011 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-11 00:44:34,015 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-11 00:44:34,015 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...tform/ALL_UNKNOWN_REPLACE
2015-02-11 00:44:34,015 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-11 00:44:34,016 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_REPLACE/_temporary
2015-02-11 00:44:34,016 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_REPLACE
2015-02-11 00:44:34,033 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:34,033 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:34,038 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:34,040 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:34,040 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:34,043 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:34,044 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:34,044 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_SWAP"]
2015-02-11 00:44:34,045 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:34,045 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:34,046 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:34,047 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...platform/ALL_UNKNOWN_SWAP
2015-02-11 00:44:34,047 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:34,048 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:34,072 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:34,091 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:34,106 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1061826036_0048
2015-02-11 00:44:34,123 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1061826036/.staging/job_local1061826036_0048/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:34,124 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1061826036/.staging/job_local1061826036_0048/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:34,170 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1061826036_0048/job_local1061826036_0048.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:34,171 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1061826036_0048/job_local1061826036_0048.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:34,172 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:34,172 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:34,172 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1061826036_0048
2015-02-11 00:44:34,172 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:34,173 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:34,175 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:34,175 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1061826036_0048_m_000000_0
2015-02-11 00:44:34,176 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:34,177 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:34,177 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@17f7b44f
2015-02-11 00:44:34,178 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:34,178 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:34,204 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:34,204 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:34,204 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:34,204 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:34,204 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:34,205 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:34,206 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:34,209 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:34,209 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:34,212 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:34,212 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:34,212 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:34,212 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:34,213 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:34,216 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:34,217 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1061826036_0048_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:34,219 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:34,219 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1061826036_0048_m_000000_0' done.
2015-02-11 00:44:34,219 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1061826036_0048_m_000000_0
2015-02-11 00:44:34,219 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:34,220 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:34,220 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1061826036_0048_r_000000_0
2015-02-11 00:44:34,222 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:34,222 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@1bffd008
2015-02-11 00:44:34,222 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552429120, maxSingleShuffleLimit=138107280, mergeThreshold=364603232, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:34,223 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1061826036_0048_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:34,224 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#48 about to shuffle output of map attempt_local1061826036_0048_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:34,225 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1061826036_0048_m_000000_0
2015-02-11 00:44:34,225 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:34,225 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:34,226 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:34,226 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:34,228 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:34,228 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:34,230 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:34,230 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:34,230 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:34,230 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:34,231 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:34,231 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:34,231 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:34,232 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:34,235 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:34,235 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_SWAP"]
2015-02-11 00:44:34,246 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1061826036_0048_r_000000_0 is done. And is in the process of committing
2015-02-11 00:44:34,247 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:34,247 INFO  mapred.Task (Task.java:commit(1162)) - Task attempt_local1061826036_0048_r_000000_0 is allowed to commit now
2015-02-11 00:44:34,248 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1061826036_0048_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_SWAP/_temporary/0/task_local1061826036_0048_r_000000
2015-02-11 00:44:34,249 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:34,249 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1061826036_0048_r_000000_0' done.
2015-02-11 00:44:34,249 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1061826036_0048_r_000000_0
2015-02-11 00:44:34,249 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:34,262 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_SWAP/_temporary
2015-02-11 00:44:34,291 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:34,321 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:34,323 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_SWAP
2015-02-11 00:44:34,340 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:34,341 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:34,346 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:34,348 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:34,349 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:34,352 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:34,352 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:34,352 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_-1"]
2015-02-11 00:44:34,352 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:34,352 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:34,353 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:34,353 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...blyplatform/ALL_VALUES_-1
2015-02-11 00:44:34,354 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:34,355 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:34,378 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:34,397 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:34,413 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1318727952_0049
2015-02-11 00:44:34,431 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1318727952/.staging/job_local1318727952_0049/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:34,432 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1318727952/.staging/job_local1318727952_0049/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:34,478 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1318727952_0049/job_local1318727952_0049.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:34,479 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1318727952_0049/job_local1318727952_0049.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:34,479 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:34,479 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:34,479 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1318727952_0049
2015-02-11 00:44:34,480 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:34,480 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:34,483 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:34,483 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1318727952_0049_m_000000_0
2015-02-11 00:44:34,484 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:34,486 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:34,486 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@3b9568ff
2015-02-11 00:44:34,488 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:34,488 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:34,514 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:34,514 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:34,515 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:34,515 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:34,515 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:34,516 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:34,516 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:34,520 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:34,520 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:34,523 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:34,523 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:34,523 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:34,524 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:34,524 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:34,527 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:34,529 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1318727952_0049_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:34,530 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:34,531 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1318727952_0049_m_000000_0' done.
2015-02-11 00:44:34,531 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1318727952_0049_m_000000_0
2015-02-11 00:44:34,531 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:34,532 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:34,532 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1318727952_0049_r_000000_0
2015-02-11 00:44:34,534 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:34,534 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@5c5f7f06
2015-02-11 00:44:34,535 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552520896, maxSingleShuffleLimit=138130224, mergeThreshold=364663808, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:34,535 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1318727952_0049_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:34,536 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#49 about to shuffle output of map attempt_local1318727952_0049_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:34,537 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1318727952_0049_m_000000_0
2015-02-11 00:44:34,537 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:34,537 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:34,538 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:34,538 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:34,540 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:34,540 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:34,543 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:34,543 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:34,543 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:34,544 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:34,544 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:34,544 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:34,545 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:34,545 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:34,548 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:34,548 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_-1"]
2015-02-11 00:44:34,556 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-11 00:44:34,557 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:34,559 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1318727952_0049
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-11 00:44:34,569 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local1318727952_0049 state at FAILED
2015-02-11 00:44:34,569 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-11 00:44:34,569 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-11 00:44:34,569 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-11 00:44:34,572 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-11 00:44:34,573 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...blyplatform/ALL_VALUES_-1
2015-02-11 00:44:34,573 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-11 00:44:34,573 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] shutting down job executor
2015-02-11 00:44:34,574 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] shutdown complete
2015-02-11 00:44:34,574 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_-1/_temporary
2015-02-11 00:44:34,574 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_-1
2015-02-11 00:44:34,591 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:34,591 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:34,595 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_'field'
2015-02-11 00:44:34,612 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:34,612 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:34,617 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:34,619 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:34,619 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:34,624 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:34,624 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:34,624 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_RESULTS"]
2015-02-11 00:44:34,624 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:34,624 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:34,625 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:34,625 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...atform/ALL_VALUES_RESULTS
2015-02-11 00:44:34,626 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:34,627 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:34,631 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:34,654 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:34,672 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:34,689 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1624130170_0050
2015-02-11 00:44:34,705 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1624130170/.staging/job_local1624130170_0050/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:34,706 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1624130170/.staging/job_local1624130170_0050/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:34,754 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1624130170_0050/job_local1624130170_0050.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:34,756 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1624130170_0050/job_local1624130170_0050.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:34,757 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:34,757 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1624130170_0050
2015-02-11 00:44:34,757 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:34,757 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:34,758 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:34,760 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:34,760 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1624130170_0050_m_000000_0
2015-02-11 00:44:34,762 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:34,763 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:34,763 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@3f47b71e
2015-02-11 00:44:34,765 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:34,765 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:34,790 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:34,790 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:34,790 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:34,791 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:34,791 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:34,792 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:34,792 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:34,796 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:34,796 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:34,799 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:34,799 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:34,799 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:34,799 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:34,799 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:34,802 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:34,804 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1624130170_0050_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:34,805 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:34,806 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1624130170_0050_m_000000_0' done.
2015-02-11 00:44:34,806 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1624130170_0050_m_000000_0
2015-02-11 00:44:34,806 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:34,806 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:34,807 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1624130170_0050_r_000000_0
2015-02-11 00:44:34,808 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:34,808 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@44f44758
2015-02-11 00:44:34,809 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552566784, maxSingleShuffleLimit=138141696, mergeThreshold=364694080, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:34,809 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1624130170_0050_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:34,811 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#50 about to shuffle output of map attempt_local1624130170_0050_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:34,811 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1624130170_0050_m_000000_0
2015-02-11 00:44:34,811 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:34,812 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:34,813 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:34,813 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:34,817 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:34,817 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:34,819 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:34,819 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:34,820 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:34,820 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:34,821 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:34,821 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:34,822 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:34,822 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:34,825 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:34,825 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_RESULTS"]
2015-02-11 00:44:34,833 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-11 00:44:34,834 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:34,836 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1624130170_0050
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-11 00:44:34,845 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local1624130170_0050 state at FAILED
2015-02-11 00:44:34,845 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-11 00:44:34,845 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-11 00:44:34,845 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-11 00:44:34,848 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-11 00:44:34,849 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...atform/ALL_VALUES_RESULTS
2015-02-11 00:44:34,851 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-11 00:44:34,852 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_RESULTS/_temporary
2015-02-11 00:44:34,852 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_RESULTS
2015-02-11 00:44:34,868 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:34,868 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:34,873 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:34,875 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:34,875 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:34,878 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:34,879 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:34,879 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_ALL"]
2015-02-11 00:44:34,880 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:34,880 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:34,881 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:34,882 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...lyplatform/ALL_VALUES_ALL
2015-02-11 00:44:34,882 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:34,883 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:34,906 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:34,917 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:34,926 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:34,942 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local282024923_0051
2015-02-11 00:44:34,958 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity282024923/.staging/job_local282024923_0051/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:34,959 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity282024923/.staging/job_local282024923_0051/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:35,005 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local282024923_0051/job_local282024923_0051.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:35,006 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local282024923_0051/job_local282024923_0051.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:35,007 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:35,007 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:35,007 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local282024923_0051
2015-02-11 00:44:35,007 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:35,007 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:35,009 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:35,010 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local282024923_0051_m_000000_0
2015-02-11 00:44:35,011 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:35,012 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:35,012 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@78693d23
2015-02-11 00:44:35,013 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:35,013 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:35,039 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:35,039 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:35,039 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:35,040 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:35,040 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:35,041 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:35,041 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:35,046 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:35,046 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:35,049 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:35,049 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:35,049 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:35,049 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:35,049 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:35,052 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:35,054 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local282024923_0051_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:35,055 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:35,055 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local282024923_0051_m_000000_0' done.
2015-02-11 00:44:35,056 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local282024923_0051_m_000000_0
2015-02-11 00:44:35,056 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:35,056 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:35,056 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local282024923_0051_r_000000_0
2015-02-11 00:44:35,058 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:35,058 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@42b8cabe
2015-02-11 00:44:35,058 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552612672, maxSingleShuffleLimit=138153168, mergeThreshold=364724384, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:35,059 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local282024923_0051_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:35,060 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#51 about to shuffle output of map attempt_local282024923_0051_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:35,061 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local282024923_0051_m_000000_0
2015-02-11 00:44:35,061 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:35,061 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:35,062 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:35,062 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:35,064 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:35,064 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:35,066 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:35,066 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:35,067 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:35,067 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:35,067 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:35,068 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:35,068 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:35,068 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:35,072 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:35,072 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_ALL"]
2015-02-11 00:44:35,080 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-11 00:44:35,083 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:35,085 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local282024923_0051
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-11 00:44:35,093 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local282024923_0051 state at FAILED
2015-02-11 00:44:35,093 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-11 00:44:35,094 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-11 00:44:35,094 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-11 00:44:35,097 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-11 00:44:35,097 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...lyplatform/ALL_VALUES_ALL
2015-02-11 00:44:35,098 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-11 00:44:35,098 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_ALL/_temporary
2015-02-11 00:44:35,098 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_ALL
2015-02-11 00:44:35,115 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:35,115 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:35,120 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:35,121 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:35,122 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:35,125 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:35,125 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:35,126 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_REPLACE"]
2015-02-11 00:44:35,126 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:35,126 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:35,126 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:35,127 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...atform/ALL_VALUES_REPLACE
2015-02-11 00:44:35,128 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:35,128 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:35,152 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:35,165 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:35,171 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:35,186 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local574428944_0052
2015-02-11 00:44:35,203 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity574428944/.staging/job_local574428944_0052/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:35,204 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity574428944/.staging/job_local574428944_0052/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:35,250 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local574428944_0052/job_local574428944_0052.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:35,251 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local574428944_0052/job_local574428944_0052.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:35,252 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:35,252 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local574428944_0052
2015-02-11 00:44:35,252 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:35,252 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:35,252 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:35,254 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:35,255 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local574428944_0052_m_000000_0
2015-02-11 00:44:35,256 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:35,258 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:35,258 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@4c1db3de
2015-02-11 00:44:35,260 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:35,260 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:35,285 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:35,285 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:35,286 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:35,286 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:35,286 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:35,287 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:35,287 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:35,291 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:35,291 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:35,294 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:35,294 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:35,294 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:35,295 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:35,295 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:35,298 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:35,300 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local574428944_0052_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:35,302 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:35,302 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local574428944_0052_m_000000_0' done.
2015-02-11 00:44:35,302 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local574428944_0052_m_000000_0
2015-02-11 00:44:35,303 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:35,303 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:35,303 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local574428944_0052_r_000000_0
2015-02-11 00:44:35,305 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:35,305 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@402d0155
2015-02-11 00:44:35,306 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552658496, maxSingleShuffleLimit=138164624, mergeThreshold=364754624, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:35,307 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local574428944_0052_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:35,308 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#52 about to shuffle output of map attempt_local574428944_0052_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:35,308 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local574428944_0052_m_000000_0
2015-02-11 00:44:35,309 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:35,309 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:35,310 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:35,310 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:35,312 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:35,312 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:35,314 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:35,314 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:35,315 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:35,315 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:35,315 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:35,316 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:35,316 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:35,317 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:35,320 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:35,320 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_REPLACE"]
2015-02-11 00:44:35,329 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-11 00:44:35,332 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:35,334 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local574428944_0052
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-11 00:44:35,340 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local574428944_0052 state at FAILED
2015-02-11 00:44:35,340 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-11 00:44:35,340 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-11 00:44:35,340 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-11 00:44:35,343 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-11 00:44:35,345 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...atform/ALL_VALUES_REPLACE
2015-02-11 00:44:35,345 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-11 00:44:35,346 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_REPLACE/_temporary
2015-02-11 00:44:35,346 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_REPLACE
2015-02-11 00:44:35,362 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:35,362 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:35,367 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:35,369 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:35,369 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:35,372 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:35,372 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:35,373 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_SWAP"]
2015-02-11 00:44:35,373 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:35,373 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:35,374 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:35,375 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...yplatform/ALL_VALUES_SWAP
2015-02-11 00:44:35,375 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:35,376 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:35,399 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:35,417 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:35,419 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:35,435 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1484244429_0053
2015-02-11 00:44:35,453 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1484244429/.staging/job_local1484244429_0053/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:35,454 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1484244429/.staging/job_local1484244429_0053/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:35,504 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1484244429_0053/job_local1484244429_0053.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:35,505 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1484244429_0053/job_local1484244429_0053.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:35,506 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:35,506 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:35,506 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1484244429_0053
2015-02-11 00:44:35,506 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:35,506 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:35,508 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:35,509 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1484244429_0053_m_000000_0
2015-02-11 00:44:35,510 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:35,511 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:35,511 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@49ea903c
2015-02-11 00:44:35,512 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:35,512 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:35,538 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:35,538 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:35,538 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:35,538 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:35,538 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:35,539 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:35,539 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:35,543 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:35,543 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:35,546 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:35,546 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:35,546 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:35,546 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:35,546 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:35,549 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:35,551 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1484244429_0053_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:35,552 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:35,552 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1484244429_0053_m_000000_0' done.
2015-02-11 00:44:35,553 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1484244429_0053_m_000000_0
2015-02-11 00:44:35,553 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:35,553 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:35,554 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1484244429_0053_r_000000_0
2015-02-11 00:44:35,555 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:35,555 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@7885bab4
2015-02-11 00:44:35,555 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552383296, maxSingleShuffleLimit=138095824, mergeThreshold=364572992, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:35,556 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1484244429_0053_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:35,557 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#53 about to shuffle output of map attempt_local1484244429_0053_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:35,558 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1484244429_0053_m_000000_0
2015-02-11 00:44:35,558 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:35,558 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:35,559 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:35,559 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:35,561 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:35,561 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:35,562 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:35,563 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:35,563 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:35,563 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:35,563 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:35,564 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:35,564 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:35,564 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:35,567 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:35,568 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_SWAP"]
2015-02-11 00:44:35,575 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-11 00:44:35,576 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:35,578 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1484244429_0053
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-11 00:44:35,582 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local1484244429_0053 state at FAILED
2015-02-11 00:44:35,582 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-11 00:44:35,582 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-11 00:44:35,582 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-11 00:44:35,585 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-11 00:44:35,587 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...yplatform/ALL_VALUES_SWAP
2015-02-11 00:44:35,589 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-11 00:44:35,589 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_SWAP/_temporary
2015-02-11 00:44:35,590 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_SWAP
2015-02-11 00:44:35,606 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:35,606 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:35,611 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:35,612 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:35,613 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:35,616 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:35,616 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:35,616 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_-1"]
2015-02-11 00:44:35,617 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:35,617 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:35,617 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:35,618 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...emblyplatform/ALL_ARGS_-1
2015-02-11 00:44:35,618 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:35,619 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:35,642 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:35,660 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:35,676 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-11 00:44:35,677 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1428662401_0054
2015-02-11 00:44:35,694 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1428662401/.staging/job_local1428662401_0054/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:35,695 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1428662401/.staging/job_local1428662401_0054/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:35,741 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1428662401_0054/job_local1428662401_0054.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:35,743 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1428662401_0054/job_local1428662401_0054.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:35,743 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:35,743 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:35,743 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1428662401_0054
2015-02-11 00:44:35,744 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:35,743 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:35,746 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:35,746 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1428662401_0054_m_000000_0
2015-02-11 00:44:35,747 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:35,748 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:35,748 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@7612e9d2
2015-02-11 00:44:35,749 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:35,750 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:35,775 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:35,775 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:35,775 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:35,775 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:35,775 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:35,776 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:35,776 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:35,780 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:35,780 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:35,783 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:35,783 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:35,783 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:35,783 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:35,783 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:35,786 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:35,788 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1428662401_0054_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:35,789 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:35,789 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1428662401_0054_m_000000_0' done.
2015-02-11 00:44:35,789 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1428662401_0054_m_000000_0
2015-02-11 00:44:35,790 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:35,790 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:35,790 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1428662401_0054_r_000000_0
2015-02-11 00:44:35,792 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:35,792 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@3d603dc
2015-02-11 00:44:35,792 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552245632, maxSingleShuffleLimit=138061408, mergeThreshold=364482144, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:35,793 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1428662401_0054_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:35,794 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#54 about to shuffle output of map attempt_local1428662401_0054_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:35,795 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1428662401_0054_m_000000_0
2015-02-11 00:44:35,795 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:35,795 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:35,796 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:35,796 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:35,798 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:35,798 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:35,799 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:35,800 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:35,800 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:35,800 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:35,800 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:35,801 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:35,801 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:35,801 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:35,804 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:35,804 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_-1"]
2015-02-11 00:44:35,813 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-11 00:44:35,813 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:35,815 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1428662401_0054
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-11 00:44:35,820 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local1428662401_0054 state at FAILED
2015-02-11 00:44:35,820 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-11 00:44:35,820 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-11 00:44:35,820 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-11 00:44:35,823 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-11 00:44:35,824 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...emblyplatform/ALL_ARGS_-1
2015-02-11 00:44:35,824 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-11 00:44:35,825 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_-1/_temporary
2015-02-11 00:44:35,825 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_-1
2015-02-11 00:44:35,841 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:35,841 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:35,845 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_'field'
2015-02-11 00:44:35,861 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:35,861 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:35,865 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:35,867 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:35,868 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:35,871 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:35,871 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:35,871 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_RESULTS"]
2015-02-11 00:44:35,871 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:35,871 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:35,872 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:35,872 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...platform/ALL_ARGS_RESULTS
2015-02-11 00:44:35,873 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:35,873 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:35,897 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:35,915 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:35,930 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local747120294_0055
2015-02-11 00:44:35,947 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity747120294/.staging/job_local747120294_0055/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:35,947 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity747120294/.staging/job_local747120294_0055/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:35,993 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local747120294_0055/job_local747120294_0055.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:35,995 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local747120294_0055/job_local747120294_0055.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:35,995 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:35,995 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:35,995 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local747120294_0055
2015-02-11 00:44:35,996 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:35,995 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:35,998 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:35,999 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local747120294_0055_m_000000_0
2015-02-11 00:44:36,001 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:36,002 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:36,003 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@7c54ef42
2015-02-11 00:44:36,004 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:36,005 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:36,030 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:36,031 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:36,032 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:36,032 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:36,033 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:36,034 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:36,035 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:36,038 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:36,039 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:36,041 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:36,042 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:36,042 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:36,042 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:36,042 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:36,045 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:36,047 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local747120294_0055_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:36,049 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:36,049 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local747120294_0055_m_000000_0' done.
2015-02-11 00:44:36,050 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local747120294_0055_m_000000_0
2015-02-11 00:44:36,050 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:36,050 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:36,051 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local747120294_0055_r_000000_0
2015-02-11 00:44:36,052 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:36,052 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@45b44df2
2015-02-11 00:44:36,053 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552383296, maxSingleShuffleLimit=138095824, mergeThreshold=364572992, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:36,053 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local747120294_0055_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:36,055 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#55 about to shuffle output of map attempt_local747120294_0055_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:36,055 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local747120294_0055_m_000000_0
2015-02-11 00:44:36,055 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:36,056 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:36,056 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:36,057 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:36,058 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:36,058 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:36,063 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:36,063 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:36,063 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:36,063 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:36,064 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:36,064 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:36,064 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:36,064 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:36,068 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:36,068 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_RESULTS"]
2015-02-11 00:44:36,076 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-11 00:44:36,077 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:36,078 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local747120294_0055
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-11 00:44:36,085 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local747120294_0055 state at FAILED
2015-02-11 00:44:36,085 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-11 00:44:36,085 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-11 00:44:36,085 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-11 00:44:36,088 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-11 00:44:36,089 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...platform/ALL_ARGS_RESULTS
2015-02-11 00:44:36,089 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-11 00:44:36,090 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_RESULTS/_temporary
2015-02-11 00:44:36,090 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_RESULTS
2015-02-11 00:44:36,107 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:36,107 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:36,111 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_ALL
2015-02-11 00:44:36,127 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:36,127 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:36,132 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:36,134 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:36,134 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:36,137 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:36,137 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:36,138 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_REPLACE"]
2015-02-11 00:44:36,138 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:36,139 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:36,139 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:36,140 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...platform/ALL_ARGS_REPLACE
2015-02-11 00:44:36,141 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:36,142 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:36,165 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:36,184 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:36,199 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local2039818532_0056
2015-02-11 00:44:36,216 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity2039818532/.staging/job_local2039818532_0056/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:36,217 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity2039818532/.staging/job_local2039818532_0056/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:36,262 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2039818532_0056/job_local2039818532_0056.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:36,263 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2039818532_0056/job_local2039818532_0056.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:36,264 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:36,264 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:36,264 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local2039818532_0056
2015-02-11 00:44:36,264 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:36,264 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:36,266 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:36,267 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local2039818532_0056_m_000000_0
2015-02-11 00:44:36,268 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:36,269 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:36,269 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@405890bd
2015-02-11 00:44:36,270 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:36,270 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:36,295 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:36,296 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:36,296 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:36,296 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:36,296 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:36,297 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:36,297 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:36,301 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:36,301 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:36,303 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:36,304 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:36,304 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:36,304 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:36,304 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:36,307 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:36,309 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local2039818532_0056_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:36,311 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:36,311 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local2039818532_0056_m_000000_0' done.
2015-02-11 00:44:36,311 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local2039818532_0056_m_000000_0
2015-02-11 00:44:36,311 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:36,312 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:36,312 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local2039818532_0056_r_000000_0
2015-02-11 00:44:36,313 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:36,314 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@8b99fe2
2015-02-11 00:44:36,314 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=551465792, maxSingleShuffleLimit=137866448, mergeThreshold=363967424, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:36,315 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local2039818532_0056_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:36,316 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#56 about to shuffle output of map attempt_local2039818532_0056_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:36,317 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local2039818532_0056_m_000000_0
2015-02-11 00:44:36,317 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:36,318 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:36,318 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:36,318 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:36,320 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:36,320 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:36,322 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:36,322 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:36,322 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:36,323 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:36,323 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:36,323 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:36,324 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:36,324 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:36,327 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:36,327 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_REPLACE"]
2015-02-11 00:44:36,335 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-11 00:44:36,336 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:36,341 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local2039818532_0056
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-11 00:44:36,350 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local2039818532_0056 state at FAILED
2015-02-11 00:44:36,350 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-11 00:44:36,350 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-11 00:44:36,350 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-11 00:44:36,353 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-11 00:44:36,355 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...platform/ALL_ARGS_REPLACE
2015-02-11 00:44:36,355 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-11 00:44:36,356 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_REPLACE/_temporary
2015-02-11 00:44:36,356 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_REPLACE
2015-02-11 00:44:36,372 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-11 00:44:36,373 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-11 00:44:36,377 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-11 00:44:36,379 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-11 00:44:36,380 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1019)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-11 00:44:36,382 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-11 00:44:36,383 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:36,383 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_SWAP"]
2015-02-11 00:44:36,383 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-11 00:44:36,383 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-11 00:44:36,383 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-11 00:44:36,384 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...blyplatform/ALL_ARGS_SWAP
2015-02-11 00:44:36,384 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:36,385 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-11 00:44:36,409 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-11 00:44:36,428 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-11 00:44:36,444 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1471620709_0057
2015-02-11 00:44:36,460 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1471620709/.staging/job_local1471620709_0057/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:36,461 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/tmp/cascading/staging/teamcity1471620709/.staging/job_local1471620709_0057/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:36,508 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1471620709_0057/job_local1471620709_0057.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-11 00:44:36,509 WARN  conf.Configuration (Configuration.java:loadProperty(2368)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1471620709_0057/job_local1471620709_0057.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-11 00:44:36,509 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-11 00:44:36,510 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1471620709_0057
2015-02-11 00:44:36,510 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-11 00:44:36,510 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-11 00:44:36,510 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-11 00:44:36,512 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-11 00:44:36,512 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1471620709_0057_m_000000_0
2015-02-11 00:44:36,514 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:36,515 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt
2015-02-11 00:44:36,515 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@69b8935b
2015-02-11 00:44:36,516 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-11 00:44:36,516 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-11 00:44:36,542 INFO  mapred.MapTask (MapTask.java:setEquator(1182)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-11 00:44:36,542 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-11 00:44:36,542 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-11 00:44:36,542 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-11 00:44:36,542 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-11 00:44:36,543 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-11 00:44:36,544 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-11 00:44:36,547 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt"]
2015-02-11 00:44:36,547 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:36,550 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-11 00:44:36,550 INFO  mapred.MapTask (MapTask.java:flush(1437)) - Starting flush of map output
2015-02-11 00:44:36,550 INFO  mapred.MapTask (MapTask.java:flush(1455)) - Spilling map output
2015-02-11 00:44:36,551 INFO  mapred.MapTask (MapTask.java:flush(1456)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-11 00:44:36,551 INFO  mapred.MapTask (MapTask.java:flush(1458)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-11 00:44:36,554 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1641)) - Finished spill 0
2015-02-11 00:44:36,556 INFO  mapred.Task (Task.java:done(1001)) - Task:attempt_local1471620709_0057_m_000000_0 is done. And is in the process of committing
2015-02-11 00:44:36,557 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/classes/test/data/nums.20.txt:0+51
2015-02-11 00:44:36,557 INFO  mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local1471620709_0057_m_000000_0' done.
2015-02-11 00:44:36,558 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1471620709_0057_m_000000_0
2015-02-11 00:44:36,558 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-11 00:44:36,558 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-11 00:44:36,558 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1471620709_0057_r_000000_0
2015-02-11 00:44:36,560 INFO  mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-11 00:44:36,560 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@165262ce
2015-02-11 00:44:36,560 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=551786880, maxSingleShuffleLimit=137946720, mergeThreshold=364179360, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-11 00:44:36,561 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1471620709_0057_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-11 00:44:36,563 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#57 about to shuffle output of map attempt_local1471620709_0057_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-11 00:44:36,563 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1471620709_0057_m_000000_0
2015-02-11 00:44:36,564 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-11 00:44:36,564 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-11 00:44:36,565 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:36,566 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-11 00:44:36,569 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:36,569 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:36,571 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-11 00:44:36,571 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-11 00:44:36,571 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-11 00:44:36,571 INFO  mapred.Merger (Merger.java:merge(591)) - Merging 1 sorted segments
2015-02-11 00:44:36,572 INFO  mapred.Merger (Merger.java:merge(690)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-11 00:44:36,572 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-11 00:44:36,572 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-11 00:44:36,573 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-11 00:44:36,576 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-11 00:44:36,576 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_SWAP"]
2015-02-11 00:44:36,584 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-11 00:44:36,585 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-11 00:44:36,587 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1471620709_0057
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-11 00:44:36,596 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local1471620709_0057 state at FAILED
2015-02-11 00:44:36,597 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-11 00:44:36,597 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-11 00:44:36,597 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-11 00:44:36,600 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-11 00:44:36,602 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...blyplatform/ALL_ARGS_SWAP
2015-02-11 00:44:36,602 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-11 00:44:36,603 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_SWAP/_temporary
2015-02-11 00:44:36,603 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.5.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_SWAP