Class cascading.detail.EveryPipeAssemblyPlatformTest

72

tests

0

failures

24.394s

duration

100%

successful

Tests

Test Duration Result
-1_'field'_'field'[hadoop2-mr1] 0.711s passed
-1_'field'_-1[hadoop2-mr1] 2.861s passed
-1_'field'_ALL[hadoop2-mr1] 0.617s passed
-1_'field'_REPLACE[hadoop2-mr1] 0.029s passed
-1_'field'_RESULTS[hadoop2-mr1] 0.652s passed
-1_'field'_SWAP[hadoop2-mr1] 0.837s passed
-1_ARGS_'field'[hadoop2-mr1] 0.023s passed
-1_ARGS_-1[hadoop2-mr1] 0.477s passed
-1_ARGS_ALL[hadoop2-mr1] 0.023s passed
-1_ARGS_REPLACE[hadoop2-mr1] 0.454s passed
-1_ARGS_RESULTS[hadoop2-mr1] 0.490s passed
-1_ARGS_SWAP[hadoop2-mr1] 0.370s passed
-1_UNKNOWN_'field'[hadoop2-mr1] 0.027s passed
-1_UNKNOWN_-1[hadoop2-mr1] 0.441s passed
-1_UNKNOWN_ALL[hadoop2-mr1] 0.505s passed
-1_UNKNOWN_REPLACE[hadoop2-mr1] 0.442s passed
-1_UNKNOWN_RESULTS[hadoop2-mr1] 0.519s passed
-1_UNKNOWN_SWAP[hadoop2-mr1] 0.531s passed
-1_VALUES_'field'[hadoop2-mr1] 0.024s passed
-1_VALUES_-1[hadoop2-mr1] 0.664s passed
-1_VALUES_ALL[hadoop2-mr1] 0.396s passed
-1_VALUES_REPLACE[hadoop2-mr1] 0.393s passed
-1_VALUES_RESULTS[hadoop2-mr1] 0.401s passed
-1_VALUES_SWAP[hadoop2-mr1] 0.507s passed
0_'field'_'field'[hadoop2-mr1] 0.380s passed
0_'field'_-1[hadoop2-mr1] 0.368s passed
0_'field'_ALL[hadoop2-mr1] 0.352s passed
0_'field'_REPLACE[hadoop2-mr1] 0.022s passed
0_'field'_RESULTS[hadoop2-mr1] 0.467s passed
0_'field'_SWAP[hadoop2-mr1] 0.331s passed
0_ARGS_'field'[hadoop2-mr1] 0.020s passed
0_ARGS_-1[hadoop2-mr1] 0.309s passed
0_ARGS_ALL[hadoop2-mr1] 0.021s passed
0_ARGS_REPLACE[hadoop2-mr1] 0.325s passed
0_ARGS_RESULTS[hadoop2-mr1] 0.309s passed
0_ARGS_SWAP[hadoop2-mr1] 0.595s passed
0_UNKNOWN_'field'[hadoop2-mr1] 0.021s passed
0_UNKNOWN_-1[hadoop2-mr1] 0.338s passed
0_UNKNOWN_ALL[hadoop2-mr1] 0.321s passed
0_UNKNOWN_REPLACE[hadoop2-mr1] 0.260s passed
0_UNKNOWN_RESULTS[hadoop2-mr1] 0.327s passed
0_UNKNOWN_SWAP[hadoop2-mr1] 0.325s passed
0_VALUES_'field'[hadoop2-mr1] 0.021s passed
0_VALUES_-1[hadoop2-mr1] 0.253s passed
0_VALUES_ALL[hadoop2-mr1] 0.252s passed
0_VALUES_REPLACE[hadoop2-mr1] 0.346s passed
0_VALUES_RESULTS[hadoop2-mr1] 0.255s passed
0_VALUES_SWAP[hadoop2-mr1] 0.239s passed
ALL_'field'_'field'[hadoop2-mr1] 0.315s passed
ALL_'field'_-1[hadoop2-mr1] 0.322s passed
ALL_'field'_ALL[hadoop2-mr1] 0.324s passed
ALL_'field'_REPLACE[hadoop2-mr1] 0.019s passed
ALL_'field'_RESULTS[hadoop2-mr1] 0.310s passed
ALL_'field'_SWAP[hadoop2-mr1] 0.313s passed
ALL_ARGS_'field'[hadoop2-mr1] 0.019s passed
ALL_ARGS_-1[hadoop2-mr1] 0.234s passed
ALL_ARGS_ALL[hadoop2-mr1] 0.019s passed
ALL_ARGS_REPLACE[hadoop2-mr1] 0.235s passed
ALL_ARGS_RESULTS[hadoop2-mr1] 0.222s passed
ALL_ARGS_SWAP[hadoop2-mr1] 0.231s passed
ALL_UNKNOWN_'field'[hadoop2-mr1] 0.019s passed
ALL_UNKNOWN_-1[hadoop2-mr1] 0.308s passed
ALL_UNKNOWN_ALL[hadoop2-mr1] 0.304s passed
ALL_UNKNOWN_REPLACE[hadoop2-mr1] 0.254s passed
ALL_UNKNOWN_RESULTS[hadoop2-mr1] 0.304s passed
ALL_UNKNOWN_SWAP[hadoop2-mr1] 0.307s passed
ALL_VALUES_'field'[hadoop2-mr1] 0.019s passed
ALL_VALUES_-1[hadoop2-mr1] 0.229s passed
ALL_VALUES_ALL[hadoop2-mr1] 0.508s passed
ALL_VALUES_REPLACE[hadoop2-mr1] 0.232s passed
ALL_VALUES_RESULTS[hadoop2-mr1] 0.245s passed
ALL_VALUES_SWAP[hadoop2-mr1] 0.251s passed

Standard output

2015-02-10 20:59:17,758 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(187)) - found 1 test platforms from classpath
2015-02-10 20:59:17,822 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(237)) - installing platform: hadoop2-mr1
2015-02-10 20:59:17,822 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(238)) - running test: cascading.detail.EveryPipeAssemblyPlatformTest
2015-02-10 20:59:17,940 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:17,958 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:17,969 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:17,980 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:17,991 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:17,991 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,002 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,013 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,013 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,024 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,035 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,036 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,047 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,049 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,049 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,050 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,051 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,051 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,052 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,063 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,063 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,073 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,073 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,084 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,094 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,105 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,115 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,124 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,134 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,134 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,144 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,151 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,152 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,160 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,166 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,167 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,171 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,171 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,172 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,172 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,173 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,173 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,174 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,178 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,178 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,182 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,183 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,187 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,191 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,194 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,199 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,203 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,207 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,208 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,212 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,217 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,218 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,224 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,232 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,232 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,240 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,240 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,241 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,241 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,242 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,242 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,242 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,243 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,243 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,244 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,244 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,245 INFO  detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,268 INFO  hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(105)) - not using cluster
2015-02-10 20:59:18,909 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2015-02-10 20:59:19,199 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:19,201 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:19,215 INFO  property.AppProps (AppProps.java:getAppID(169)) - using app.id: D3AAD3C110B048D3A631EED30C6466C8
2015-02-10 20:59:19,297 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:19,332 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:19,336 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:19,449 INFO  util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 2.6.3
2015-02-10 20:59:19,451 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:19,452 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:19,452 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_-1"]
2015-02-10 20:59:19,452 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:19,453 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:19,453 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:19,454 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...blyplatform/-1_'field'_-1
2015-02-10 20:59:19,481 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - session.id is deprecated. Instead, use dfs.metrics.session-id
2015-02-10 20:59:19,482 INFO  jvm.JvmMetrics (JvmMetrics.java:init(76)) - Initializing JVM Metrics with processName=JobTracker, sessionId=
2015-02-10 20:59:19,515 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:19,907 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:19,947 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:20,104 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1160515025_0001
2015-02-10 20:59:20,146 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1160515025/.staging/job_local1160515025_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:20,147 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1160515025/.staging/job_local1160515025_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:20,349 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1160515025_0001/job_local1160515025_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:20,350 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1160515025_0001/job_local1160515025_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:20,360 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:20,362 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:20,365 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1160515025_0001
2015-02-10 20:59:20,365 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:20,366 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:20,426 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:20,430 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1160515025_0001_m_000000_0
2015-02-10 20:59:20,473 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:20,483 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:20,484 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@92ca580
2015-02-10 20:59:20,494 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:20,501 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:20,653 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:20,654 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:20,654 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:20,654 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:20,654 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:20,677 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:20,677 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:20,721 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.task.partition is deprecated. Instead, use mapreduce.task.partition
2015-02-10 20:59:20,724 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:20,725 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:20,753 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:20,753 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:20,754 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:20,754 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:20,754 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:20,767 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:20,771 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1160515025_0001_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:20,782 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:20,782 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1160515025_0001_m_000000_0' done.
2015-02-10 20:59:20,782 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1160515025_0001_m_000000_0
2015-02-10 20:59:20,782 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:20,786 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:20,786 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1160515025_0001_r_000000_0
2015-02-10 20:59:20,795 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:20,798 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@3429cf1
2015-02-10 20:59:20,812 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:20,816 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1160515025_0001_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:20,849 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#1 about to shuffle output of map attempt_local1160515025_0001_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:20,854 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1160515025_0001_m_000000_0
2015-02-10 20:59:20,897 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:20,900 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:20,901 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:20,902 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:20,911 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:20,911 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:20,915 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:20,916 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:20,917 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:20,917 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:20,918 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:20,919 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:20,921 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:20,921 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:20,945 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:20,945 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_-1"]
2015-02-10 20:59:20,973 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1160515025_0001_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:20,975 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:20,975 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local1160515025_0001_r_000000_0 is allowed to commit now
2015-02-10 20:59:20,977 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1160515025_0001_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_-1/_temporary/0/task_local1160515025_0001_r_000000
2015-02-10 20:59:20,978 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:20,978 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1160515025_0001_r_000000_0' done.
2015-02-10 20:59:20,979 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1160515025_0001_r_000000_0
2015-02-10 20:59:20,979 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:21,025 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_-1/_temporary
2015-02-10 20:59:21,081 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:21,125 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:21,127 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_'field'_-1
2015-02-10 20:59:21,153 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:21,153 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:21,169 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:21,175 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:21,175 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:21,186 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:21,186 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:21,187 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_'field'"]
2015-02-10 20:59:21,187 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:21,187 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:21,187 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:21,188 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...atform/-1_'field'_'field'
2015-02-10 20:59:21,190 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:21,192 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:21,225 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:21,250 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:21,287 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local737083168_0002
2015-02-10 20:59:21,309 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity737083168/.staging/job_local737083168_0002/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:21,309 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity737083168/.staging/job_local737083168_0002/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:21,397 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local737083168_0002/job_local737083168_0002.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:21,398 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local737083168_0002/job_local737083168_0002.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:21,400 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:21,400 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local737083168_0002
2015-02-10 20:59:21,400 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:21,401 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:21,402 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:21,406 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:21,406 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local737083168_0002_m_000000_0
2015-02-10 20:59:21,410 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:21,412 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:21,412 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@72cc5002
2015-02-10 20:59:21,415 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:21,415 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:21,571 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:21,571 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:21,571 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:21,571 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:21,572 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:21,574 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:21,574 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:21,585 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:21,586 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:21,590 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:21,591 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:21,591 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:21,591 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:21,591 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:21,655 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:21,659 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local737083168_0002_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:21,662 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:21,662 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local737083168_0002_m_000000_0' done.
2015-02-10 20:59:21,662 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local737083168_0002_m_000000_0
2015-02-10 20:59:21,662 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:21,663 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:21,663 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local737083168_0002_r_000000_0
2015-02-10 20:59:21,666 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:21,666 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@16fa21a4
2015-02-10 20:59:21,667 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:21,668 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local737083168_0002_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:21,672 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#2 about to shuffle output of map attempt_local737083168_0002_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:21,673 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local737083168_0002_m_000000_0
2015-02-10 20:59:21,673 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:21,674 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:21,676 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:21,676 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:21,679 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:21,679 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:21,682 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:21,682 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:21,682 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:21,683 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:21,683 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:21,685 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:21,685 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:21,686 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:21,697 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:21,697 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_'field'"]
2015-02-10 20:59:21,716 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local737083168_0002_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:21,718 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:21,719 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local737083168_0002_r_000000_0 is allowed to commit now
2015-02-10 20:59:21,720 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local737083168_0002_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_'field'/_temporary/0/task_local737083168_0002_r_000000
2015-02-10 20:59:21,722 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:21,722 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local737083168_0002_r_000000_0' done.
2015-02-10 20:59:21,722 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local737083168_0002_r_000000_0
2015-02-10 20:59:21,722 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:21,752 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_'field'/_temporary
2015-02-10 20:59:21,794 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:21,838 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:21,840 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_'field'_'field'
2015-02-10 20:59:21,868 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:21,869 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:21,885 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:21,908 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:21,909 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:21,918 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:21,918 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:21,920 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_RESULTS"]
2015-02-10 20:59:21,920 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:21,920 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:21,920 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:21,921 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...atform/-1_'field'_RESULTS
2015-02-10 20:59:21,922 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:21,924 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:21,956 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:21,981 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:22,025 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local889177484_0003
2015-02-10 20:59:22,055 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity889177484/.staging/job_local889177484_0003/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:22,055 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity889177484/.staging/job_local889177484_0003/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:22,132 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local889177484_0003/job_local889177484_0003.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:22,133 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local889177484_0003/job_local889177484_0003.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:22,135 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:22,135 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local889177484_0003
2015-02-10 20:59:22,135 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:22,136 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:22,137 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:22,142 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:22,143 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local889177484_0003_m_000000_0
2015-02-10 20:59:22,146 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:22,148 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:22,149 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@381bd13
2015-02-10 20:59:22,151 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:22,151 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:22,296 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:22,296 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:22,296 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:22,296 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:22,297 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:22,298 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:22,298 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:22,309 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:22,309 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:22,313 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:22,314 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:22,314 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:22,314 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:22,314 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:22,319 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:22,322 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local889177484_0003_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:22,324 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:22,325 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local889177484_0003_m_000000_0' done.
2015-02-10 20:59:22,325 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local889177484_0003_m_000000_0
2015-02-10 20:59:22,325 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:22,326 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:22,326 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local889177484_0003_r_000000_0
2015-02-10 20:59:22,329 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:22,329 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@976484e
2015-02-10 20:59:22,330 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:22,331 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local889177484_0003_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:22,333 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#3 about to shuffle output of map attempt_local889177484_0003_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:22,334 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local889177484_0003_m_000000_0
2015-02-10 20:59:22,334 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:22,335 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:22,336 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:22,336 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:22,339 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:22,339 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:22,343 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:22,344 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:22,344 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:22,344 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:22,344 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:22,345 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:22,346 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:22,346 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:22,356 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:22,356 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_RESULTS"]
2015-02-10 20:59:22,372 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local889177484_0003_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:22,374 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:22,374 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local889177484_0003_r_000000_0 is allowed to commit now
2015-02-10 20:59:22,376 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local889177484_0003_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_RESULTS/_temporary/0/task_local889177484_0003_r_000000
2015-02-10 20:59:22,377 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:22,378 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local889177484_0003_r_000000_0' done.
2015-02-10 20:59:22,378 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local889177484_0003_r_000000_0
2015-02-10 20:59:22,378 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:22,409 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_RESULTS/_temporary
2015-02-10 20:59:22,450 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:22,490 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:22,492 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_'field'_RESULTS
2015-02-10 20:59:22,517 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:22,518 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:22,531 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:22,540 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:22,541 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:22,549 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:22,549 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:22,550 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_ALL"]
2015-02-10 20:59:22,550 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:22,550 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:22,550 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:22,552 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...lyplatform/-1_'field'_ALL
2015-02-10 20:59:22,553 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:22,555 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:22,587 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:22,608 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:22,628 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local222035647_0004
2015-02-10 20:59:22,650 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity222035647/.staging/job_local222035647_0004/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:22,650 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity222035647/.staging/job_local222035647_0004/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:22,718 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local222035647_0004/job_local222035647_0004.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:22,718 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local222035647_0004/job_local222035647_0004.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:22,720 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:22,721 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:22,721 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:22,721 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local222035647_0004
2015-02-10 20:59:22,721 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:22,725 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:22,726 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local222035647_0004_m_000000_0
2015-02-10 20:59:22,729 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:22,732 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:22,732 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@79424b7b
2015-02-10 20:59:22,735 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:22,735 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:22,900 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:22,901 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:22,901 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:22,901 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:22,901 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:22,903 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:22,904 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:22,915 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:22,915 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:22,919 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:22,919 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:22,919 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:22,920 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:22,920 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:22,925 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:22,928 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local222035647_0004_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:22,930 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:22,931 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local222035647_0004_m_000000_0' done.
2015-02-10 20:59:22,931 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local222035647_0004_m_000000_0
2015-02-10 20:59:22,931 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:22,932 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:22,932 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local222035647_0004_r_000000_0
2015-02-10 20:59:22,935 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:22,935 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@42db681c
2015-02-10 20:59:22,936 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:22,937 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local222035647_0004_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:22,939 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#4 about to shuffle output of map attempt_local222035647_0004_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:22,940 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local222035647_0004_m_000000_0
2015-02-10 20:59:22,940 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:22,941 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:22,942 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:22,942 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:22,948 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:22,948 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:22,951 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:22,951 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:22,952 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:22,952 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:22,953 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:22,954 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:22,954 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:22,954 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:22,964 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:22,964 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_ALL"]
2015-02-10 20:59:22,981 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local222035647_0004_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:22,983 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:22,983 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local222035647_0004_r_000000_0 is allowed to commit now
2015-02-10 20:59:22,984 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local222035647_0004_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_ALL/_temporary/0/task_local222035647_0004_r_000000
2015-02-10 20:59:22,986 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:22,986 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local222035647_0004_r_000000_0' done.
2015-02-10 20:59:22,986 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local222035647_0004_r_000000_0
2015-02-10 20:59:22,986 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:23,015 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_ALL/_temporary
2015-02-10 20:59:23,067 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:23,109 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:23,110 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_'field'_ALL
2015-02-10 20:59:23,129 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:23,130 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:23,140 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_'field'_REPLACE
2015-02-10 20:59:23,158 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:23,159 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:23,169 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:23,173 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:23,174 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:23,182 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:23,182 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:23,182 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_SWAP"]
2015-02-10 20:59:23,183 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:23,183 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:23,183 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:23,184 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...yplatform/-1_'field'_SWAP
2015-02-10 20:59:23,185 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:23,186 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:23,214 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:23,235 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:23,268 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local936210493_0005
2015-02-10 20:59:23,287 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity936210493/.staging/job_local936210493_0005/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:23,288 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity936210493/.staging/job_local936210493_0005/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:23,345 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local936210493_0005/job_local936210493_0005.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:23,345 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local936210493_0005/job_local936210493_0005.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:23,348 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:23,348 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:23,349 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:23,349 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local936210493_0005
2015-02-10 20:59:23,350 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:23,354 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:23,354 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local936210493_0005_m_000000_0
2015-02-10 20:59:23,357 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:23,359 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:23,359 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@1116880a
2015-02-10 20:59:23,361 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:23,362 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:23,509 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:23,510 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:23,510 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:23,510 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:23,510 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:23,512 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:23,513 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:23,522 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:23,522 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:23,526 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:23,526 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:23,527 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:23,527 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:23,527 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:23,532 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:23,534 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local936210493_0005_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:23,537 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:23,537 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local936210493_0005_m_000000_0' done.
2015-02-10 20:59:23,537 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local936210493_0005_m_000000_0
2015-02-10 20:59:23,538 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:23,538 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:23,538 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local936210493_0005_r_000000_0
2015-02-10 20:59:23,541 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:23,541 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@1e753c22
2015-02-10 20:59:23,542 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:23,542 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local936210493_0005_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:23,544 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#5 about to shuffle output of map attempt_local936210493_0005_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:23,545 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local936210493_0005_m_000000_0
2015-02-10 20:59:23,545 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:23,546 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:23,547 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:23,547 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:23,551 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:23,551 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:23,553 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:23,553 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:23,554 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:23,554 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:23,554 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:23,555 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:23,555 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:23,555 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:23,564 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:23,564 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_SWAP"]
2015-02-10 20:59:23,579 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local936210493_0005_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:23,581 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:23,581 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local936210493_0005_r_000000_0 is allowed to commit now
2015-02-10 20:59:23,582 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local936210493_0005_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_SWAP/_temporary/0/task_local936210493_0005_r_000000
2015-02-10 20:59:23,584 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:23,584 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local936210493_0005_r_000000_0' done.
2015-02-10 20:59:23,584 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local936210493_0005_r_000000_0
2015-02-10 20:59:23,585 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:23,614 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_SWAP/_temporary
2015-02-10 20:59:23,648 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:23,975 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:23,977 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_'field'_SWAP
2015-02-10 20:59:23,998 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:23,999 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:24,009 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:24,013 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:24,014 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:24,021 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:24,022 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:24,023 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_-1"]
2015-02-10 20:59:24,024 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:24,025 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:24,026 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:24,028 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...blyplatform/-1_UNKNOWN_-1
2015-02-10 20:59:24,028 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:24,030 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:24,058 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:24,078 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:24,096 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1348329142_0006
2015-02-10 20:59:24,116 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1348329142/.staging/job_local1348329142_0006/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:24,117 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1348329142/.staging/job_local1348329142_0006/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:24,172 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1348329142_0006/job_local1348329142_0006.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:24,172 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1348329142_0006/job_local1348329142_0006.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:24,173 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:24,175 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1348329142_0006
2015-02-10 20:59:24,175 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:24,175 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:24,176 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:24,179 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:24,179 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1348329142_0006_m_000000_0
2015-02-10 20:59:24,181 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:24,183 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:24,183 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@6876fb1b
2015-02-10 20:59:24,184 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:24,185 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:24,255 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:24,255 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:24,256 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:24,256 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:24,256 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:24,258 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:24,259 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:24,267 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:24,268 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:24,272 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:24,272 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:24,272 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:24,272 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:24,272 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:24,276 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:24,279 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1348329142_0006_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:24,281 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:24,281 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1348329142_0006_m_000000_0' done.
2015-02-10 20:59:24,282 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1348329142_0006_m_000000_0
2015-02-10 20:59:24,282 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:24,283 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:24,283 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1348329142_0006_r_000000_0
2015-02-10 20:59:24,285 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:24,285 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@7b76fb04
2015-02-10 20:59:24,286 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:24,287 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1348329142_0006_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:24,289 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#6 about to shuffle output of map attempt_local1348329142_0006_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:24,290 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1348329142_0006_m_000000_0
2015-02-10 20:59:24,290 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:24,290 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:24,291 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:24,292 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:24,294 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:24,294 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:24,296 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:24,297 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:24,297 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:24,297 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:24,298 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:24,298 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:24,299 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:24,299 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:24,307 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:24,307 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_-1"]
2015-02-10 20:59:24,322 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1348329142_0006_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:24,324 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:24,325 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local1348329142_0006_r_000000_0 is allowed to commit now
2015-02-10 20:59:24,326 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1348329142_0006_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_-1/_temporary/0/task_local1348329142_0006_r_000000
2015-02-10 20:59:24,328 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:24,328 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1348329142_0006_r_000000_0' done.
2015-02-10 20:59:24,329 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1348329142_0006_r_000000_0
2015-02-10 20:59:24,329 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:24,349 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_-1/_temporary
2015-02-10 20:59:24,381 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:24,416 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:24,418 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_-1
2015-02-10 20:59:24,437 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:24,437 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:24,446 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_'field'
2015-02-10 20:59:24,468 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:24,469 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:24,479 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:24,482 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:24,483 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:24,490 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:24,490 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:24,491 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_RESULTS"]
2015-02-10 20:59:24,491 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:24,492 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:24,492 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:24,493 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...atform/-1_UNKNOWN_RESULTS
2015-02-10 20:59:24,494 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:24,495 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:24,523 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:24,544 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:24,560 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1737186709_0007
2015-02-10 20:59:24,581 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1737186709/.staging/job_local1737186709_0007/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:24,581 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1737186709/.staging/job_local1737186709_0007/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:24,634 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1737186709_0007/job_local1737186709_0007.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:24,634 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1737186709_0007/job_local1737186709_0007.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:24,636 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:24,636 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1737186709_0007
2015-02-10 20:59:24,636 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:24,636 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:24,637 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:24,641 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:24,641 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1737186709_0007_m_000000_0
2015-02-10 20:59:24,643 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:24,645 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:24,646 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@4f4a1ab7
2015-02-10 20:59:24,647 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:24,648 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:24,798 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:24,798 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:24,798 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:24,799 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:24,799 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:24,801 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:24,801 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:24,809 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:24,809 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:24,813 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:24,814 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:24,814 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:24,814 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:24,814 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:24,820 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:24,822 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1737186709_0007_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:24,825 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:24,825 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1737186709_0007_m_000000_0' done.
2015-02-10 20:59:24,825 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1737186709_0007_m_000000_0
2015-02-10 20:59:24,825 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:24,826 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:24,826 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1737186709_0007_r_000000_0
2015-02-10 20:59:24,828 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:24,828 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@682f8c99
2015-02-10 20:59:24,829 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:24,830 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1737186709_0007_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:24,832 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#7 about to shuffle output of map attempt_local1737186709_0007_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:24,833 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1737186709_0007_m_000000_0
2015-02-10 20:59:24,833 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:24,834 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:24,835 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:24,835 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:24,840 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:24,840 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:24,842 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:24,842 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:24,843 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:24,843 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:24,843 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:24,844 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:24,845 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:24,845 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:24,854 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:24,854 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_RESULTS"]
2015-02-10 20:59:24,868 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1737186709_0007_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:24,870 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:24,870 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local1737186709_0007_r_000000_0 is allowed to commit now
2015-02-10 20:59:24,871 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1737186709_0007_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_RESULTS/_temporary/0/task_local1737186709_0007_r_000000
2015-02-10 20:59:24,873 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:24,873 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1737186709_0007_r_000000_0' done.
2015-02-10 20:59:24,873 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1737186709_0007_r_000000_0
2015-02-10 20:59:24,873 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:24,897 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_RESULTS/_temporary
2015-02-10 20:59:24,930 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:24,963 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:24,965 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_RESULTS
2015-02-10 20:59:24,984 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:24,985 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:24,998 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:25,001 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:25,002 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:25,010 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:25,011 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:25,011 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_ALL"]
2015-02-10 20:59:25,011 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:25,011 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:25,011 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:25,012 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...lyplatform/-1_UNKNOWN_ALL
2015-02-10 20:59:25,013 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:25,014 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:25,043 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:25,065 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:25,086 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local468581826_0008
2015-02-10 20:59:25,106 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity468581826/.staging/job_local468581826_0008/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:25,106 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity468581826/.staging/job_local468581826_0008/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:25,159 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local468581826_0008/job_local468581826_0008.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:25,160 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local468581826_0008/job_local468581826_0008.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:25,161 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:25,163 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local468581826_0008
2015-02-10 20:59:25,163 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:25,163 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:25,164 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:25,167 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:25,168 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local468581826_0008_m_000000_0
2015-02-10 20:59:25,170 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:25,171 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:25,171 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@302b2c81
2015-02-10 20:59:25,173 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:25,173 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:25,315 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:25,316 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:25,316 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:25,316 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:25,316 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:25,317 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:25,317 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:25,325 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:25,325 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:25,329 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:25,329 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:25,329 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:25,329 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:25,329 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:25,333 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:25,335 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local468581826_0008_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:25,338 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:25,338 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local468581826_0008_m_000000_0' done.
2015-02-10 20:59:25,338 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local468581826_0008_m_000000_0
2015-02-10 20:59:25,338 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:25,339 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:25,339 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local468581826_0008_r_000000_0
2015-02-10 20:59:25,341 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:25,342 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@32a88bc2
2015-02-10 20:59:25,342 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:25,343 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local468581826_0008_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:25,345 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#8 about to shuffle output of map attempt_local468581826_0008_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:25,346 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local468581826_0008_m_000000_0
2015-02-10 20:59:25,346 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:25,346 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:25,348 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:25,348 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:25,351 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:25,351 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:25,353 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:25,354 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:25,354 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:25,354 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:25,354 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:25,355 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:25,355 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:25,356 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:25,362 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:25,363 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_ALL"]
2015-02-10 20:59:25,377 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local468581826_0008_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:25,379 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:25,379 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local468581826_0008_r_000000_0 is allowed to commit now
2015-02-10 20:59:25,380 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local468581826_0008_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_ALL/_temporary/0/task_local468581826_0008_r_000000
2015-02-10 20:59:25,381 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:25,381 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local468581826_0008_r_000000_0' done.
2015-02-10 20:59:25,382 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local468581826_0008_r_000000_0
2015-02-10 20:59:25,382 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:25,404 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_ALL/_temporary
2015-02-10 20:59:25,435 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:25,468 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:25,470 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_ALL
2015-02-10 20:59:25,487 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:25,488 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:25,497 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:25,499 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:25,500 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:25,506 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:25,507 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:25,507 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_REPLACE"]
2015-02-10 20:59:25,507 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:25,507 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:25,507 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:25,508 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...atform/-1_UNKNOWN_REPLACE
2015-02-10 20:59:25,509 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:25,510 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:25,538 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:25,560 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:25,577 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local20909324_0009
2015-02-10 20:59:25,597 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity20909324/.staging/job_local20909324_0009/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:25,597 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity20909324/.staging/job_local20909324_0009/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:25,663 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local20909324_0009/job_local20909324_0009.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:25,663 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local20909324_0009/job_local20909324_0009.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:25,665 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:25,665 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local20909324_0009
2015-02-10 20:59:25,665 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:25,665 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:25,666 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:25,671 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:25,671 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local20909324_0009_m_000000_0
2015-02-10 20:59:25,674 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:25,676 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:25,676 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@5ac2480b
2015-02-10 20:59:25,678 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:25,678 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:25,821 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:25,821 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:25,821 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:25,821 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:25,821 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:25,823 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:25,823 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:25,831 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:25,831 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:25,835 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:25,835 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:25,835 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:25,836 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:25,836 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:25,840 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:25,843 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local20909324_0009_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:25,845 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:25,845 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local20909324_0009_m_000000_0' done.
2015-02-10 20:59:25,846 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local20909324_0009_m_000000_0
2015-02-10 20:59:25,846 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:25,847 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:25,847 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local20909324_0009_r_000000_0
2015-02-10 20:59:25,849 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:25,849 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@7559f3f0
2015-02-10 20:59:25,850 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:25,851 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local20909324_0009_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:25,854 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#9 about to shuffle output of map attempt_local20909324_0009_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:25,854 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local20909324_0009_m_000000_0
2015-02-10 20:59:25,855 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:25,855 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:25,857 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:25,857 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:25,859 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:25,860 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:25,862 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:25,862 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:25,862 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:25,862 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:25,863 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:25,864 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:25,864 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:25,864 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:25,872 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:25,872 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_REPLACE"]
2015-02-10 20:59:25,884 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:25,887 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:25,890 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local20909324_0009
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:25,900 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local20909324_0009 state at FAILED
2015-02-10 20:59:25,900 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 20:59:25,901 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 20:59:25,901 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 20:59:25,908 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 20:59:25,909 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...atform/-1_UNKNOWN_REPLACE
2015-02-10 20:59:25,911 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 20:59:25,912 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_REPLACE/_temporary
2015-02-10 20:59:25,912 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_REPLACE
2015-02-10 20:59:25,950 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:25,952 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:25,961 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:25,964 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:25,965 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:25,971 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:25,972 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:25,972 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_SWAP"]
2015-02-10 20:59:25,973 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:25,973 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:25,974 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:25,975 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...yplatform/-1_UNKNOWN_SWAP
2015-02-10 20:59:25,976 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:25,977 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:26,003 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:26,022 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:26,040 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local641546413_0010
2015-02-10 20:59:26,062 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity641546413/.staging/job_local641546413_0010/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:26,062 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity641546413/.staging/job_local641546413_0010/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:26,115 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local641546413_0010/job_local641546413_0010.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:26,115 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local641546413_0010/job_local641546413_0010.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:26,116 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:26,117 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local641546413_0010
2015-02-10 20:59:26,117 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:26,117 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:26,117 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:26,121 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:26,121 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local641546413_0010_m_000000_0
2015-02-10 20:59:26,123 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:26,125 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:26,125 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@3ac803e6
2015-02-10 20:59:26,127 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:26,127 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:26,284 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:26,284 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:26,284 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:26,284 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:26,284 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:26,286 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:26,286 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:26,293 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:26,294 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:26,298 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:26,298 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:26,298 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:26,298 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:26,298 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:26,303 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:26,305 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local641546413_0010_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:26,307 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:26,307 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local641546413_0010_m_000000_0' done.
2015-02-10 20:59:26,307 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local641546413_0010_m_000000_0
2015-02-10 20:59:26,308 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:26,308 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:26,309 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local641546413_0010_r_000000_0
2015-02-10 20:59:26,311 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:26,311 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@57543bc5
2015-02-10 20:59:26,312 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:26,314 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local641546413_0010_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:26,316 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#10 about to shuffle output of map attempt_local641546413_0010_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:26,316 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local641546413_0010_m_000000_0
2015-02-10 20:59:26,317 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:26,317 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:26,318 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:26,319 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:26,323 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:26,324 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:26,326 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:26,326 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:26,326 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:26,326 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:26,327 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:26,327 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:26,328 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:26,328 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:26,335 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:26,336 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_SWAP"]
2015-02-10 20:59:26,350 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local641546413_0010_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:26,352 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:26,352 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local641546413_0010_r_000000_0 is allowed to commit now
2015-02-10 20:59:26,353 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local641546413_0010_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_SWAP/_temporary/0/task_local641546413_0010_r_000000
2015-02-10 20:59:26,354 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:26,355 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local641546413_0010_r_000000_0' done.
2015-02-10 20:59:26,355 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local641546413_0010_r_000000_0
2015-02-10 20:59:26,355 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:26,378 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_SWAP/_temporary
2015-02-10 20:59:26,409 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:26,442 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:26,443 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_SWAP
2015-02-10 20:59:26,461 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:26,462 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:26,470 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:26,474 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:26,475 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:26,481 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:26,481 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:26,481 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_-1"]
2015-02-10 20:59:26,481 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:26,482 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:26,482 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:26,482 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...mblyplatform/-1_VALUES_-1
2015-02-10 20:59:26,483 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:26,484 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:26,509 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:26,528 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:26,544 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local356800678_0011
2015-02-10 20:59:26,565 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity356800678/.staging/job_local356800678_0011/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:26,565 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity356800678/.staging/job_local356800678_0011/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:26,688 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local356800678_0011/job_local356800678_0011.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:26,688 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local356800678_0011/job_local356800678_0011.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:26,690 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:26,690 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local356800678_0011
2015-02-10 20:59:26,690 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:26,691 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:26,691 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:26,695 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:26,695 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local356800678_0011_m_000000_0
2015-02-10 20:59:26,697 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:26,699 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:26,700 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@4fe7f80
2015-02-10 20:59:26,701 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:26,702 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:27,020 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:27,021 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:27,022 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:27,022 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:27,023 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:27,025 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:27,025 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:27,033 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:27,034 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:27,038 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:27,039 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:27,039 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:27,040 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:27,040 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:27,044 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:27,046 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local356800678_0011_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:27,049 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:27,049 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local356800678_0011_m_000000_0' done.
2015-02-10 20:59:27,050 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local356800678_0011_m_000000_0
2015-02-10 20:59:27,050 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:27,051 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:27,051 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local356800678_0011_r_000000_0
2015-02-10 20:59:27,053 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:27,053 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@2543472c
2015-02-10 20:59:27,054 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:27,055 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local356800678_0011_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:27,057 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#11 about to shuffle output of map attempt_local356800678_0011_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:27,057 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local356800678_0011_m_000000_0
2015-02-10 20:59:27,057 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:27,058 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:27,060 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:27,061 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:27,064 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:27,066 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:27,068 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:27,068 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:27,069 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:27,069 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:27,070 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:27,071 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:27,071 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:27,072 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:27,078 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:27,079 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_-1"]
2015-02-10 20:59:27,090 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:27,091 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:27,093 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local356800678_0011
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:27,099 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local356800678_0011 state at FAILED
2015-02-10 20:59:27,099 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 20:59:27,099 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 20:59:27,099 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 20:59:27,106 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 20:59:27,106 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...mblyplatform/-1_VALUES_-1
2015-02-10 20:59:27,107 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 20:59:27,107 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_-1/_temporary
2015-02-10 20:59:27,107 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_-1
2015-02-10 20:59:27,125 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:27,126 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:27,132 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_'field'
2015-02-10 20:59:27,149 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:27,150 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:27,158 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:27,160 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:27,161 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:27,166 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:27,167 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:27,167 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_RESULTS"]
2015-02-10 20:59:27,168 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:27,168 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:27,168 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:27,170 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...latform/-1_VALUES_RESULTS
2015-02-10 20:59:27,170 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:27,171 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:27,196 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:27,215 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:27,230 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local317740006_0012
2015-02-10 20:59:27,248 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity317740006/.staging/job_local317740006_0012/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:27,248 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity317740006/.staging/job_local317740006_0012/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:27,297 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local317740006_0012/job_local317740006_0012.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:27,298 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local317740006_0012/job_local317740006_0012.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:27,299 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:27,299 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local317740006_0012
2015-02-10 20:59:27,299 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:27,300 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:27,300 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:27,303 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:27,303 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local317740006_0012_m_000000_0
2015-02-10 20:59:27,305 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:27,306 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:27,306 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@45d45d18
2015-02-10 20:59:27,308 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:27,308 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:27,457 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:27,457 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:27,458 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:27,458 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:27,458 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:27,460 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:27,461 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:27,471 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:27,472 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:27,476 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:27,476 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:27,476 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:27,476 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:27,477 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:27,480 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:27,483 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local317740006_0012_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:27,485 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:27,485 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local317740006_0012_m_000000_0' done.
2015-02-10 20:59:27,485 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local317740006_0012_m_000000_0
2015-02-10 20:59:27,485 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:27,486 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:27,486 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local317740006_0012_r_000000_0
2015-02-10 20:59:27,489 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:27,489 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@305f6ed4
2015-02-10 20:59:27,489 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:27,490 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local317740006_0012_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:27,492 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#12 about to shuffle output of map attempt_local317740006_0012_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:27,493 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local317740006_0012_m_000000_0
2015-02-10 20:59:27,493 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:27,494 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:27,495 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:27,495 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:27,499 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:27,499 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:27,501 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:27,501 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:27,501 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:27,501 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:27,502 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:27,502 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:27,503 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:27,503 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:27,509 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:27,510 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_RESULTS"]
2015-02-10 20:59:27,519 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:27,520 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:27,522 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local317740006_0012
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:27,523 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local317740006_0012 state at FAILED
2015-02-10 20:59:27,523 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 20:59:27,523 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 20:59:27,523 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 20:59:27,530 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 20:59:27,532 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...latform/-1_VALUES_RESULTS
2015-02-10 20:59:27,532 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 20:59:27,532 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] shutting down job executor
2015-02-10 20:59:27,533 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] shutdown complete
2015-02-10 20:59:27,534 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_RESULTS/_temporary
2015-02-10 20:59:27,534 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_RESULTS
2015-02-10 20:59:27,552 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:27,552 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:27,560 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:27,562 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:27,563 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:27,568 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:27,568 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:27,568 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_ALL"]
2015-02-10 20:59:27,568 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:27,568 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:27,568 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:27,569 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...blyplatform/-1_VALUES_ALL
2015-02-10 20:59:27,570 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:27,571 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:27,596 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:27,615 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:27,631 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local413056919_0013
2015-02-10 20:59:27,649 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity413056919/.staging/job_local413056919_0013/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:27,650 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity413056919/.staging/job_local413056919_0013/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:27,700 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local413056919_0013/job_local413056919_0013.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:27,701 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local413056919_0013/job_local413056919_0013.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:27,702 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:27,702 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local413056919_0013
2015-02-10 20:59:27,702 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:27,702 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:27,703 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:27,705 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:27,706 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local413056919_0013_m_000000_0
2015-02-10 20:59:27,707 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:27,709 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:27,709 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@6c696d5c
2015-02-10 20:59:27,710 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:27,711 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:27,854 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:27,854 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:27,854 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:27,855 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:27,855 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:27,856 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:27,856 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:27,863 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:27,863 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:27,867 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:27,867 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:27,867 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:27,868 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:27,868 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:27,871 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:27,873 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local413056919_0013_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:27,875 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:27,875 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local413056919_0013_m_000000_0' done.
2015-02-10 20:59:27,876 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local413056919_0013_m_000000_0
2015-02-10 20:59:27,876 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:27,876 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:27,877 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local413056919_0013_r_000000_0
2015-02-10 20:59:27,878 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:27,879 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@6ecb741e
2015-02-10 20:59:27,879 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:27,880 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local413056919_0013_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:27,882 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#13 about to shuffle output of map attempt_local413056919_0013_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:27,883 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local413056919_0013_m_000000_0
2015-02-10 20:59:27,883 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:27,884 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:27,885 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:27,885 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:27,896 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:27,896 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:27,898 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:27,898 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:27,898 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:27,898 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:27,899 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:27,900 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:27,900 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:27,900 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:27,907 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:27,907 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_ALL"]
2015-02-10 20:59:27,916 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:27,917 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:27,919 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local413056919_0013
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:27,921 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local413056919_0013 state at FAILED
2015-02-10 20:59:27,922 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 20:59:27,922 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 20:59:27,922 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 20:59:27,928 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 20:59:27,929 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...blyplatform/-1_VALUES_ALL
2015-02-10 20:59:27,929 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 20:59:27,929 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] shutting down job executor
2015-02-10 20:59:27,930 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] shutdown complete
2015-02-10 20:59:27,931 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_ALL/_temporary
2015-02-10 20:59:27,931 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_ALL
2015-02-10 20:59:27,949 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:27,949 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:27,957 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:27,959 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:27,959 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:27,964 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:27,964 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:27,964 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_REPLACE"]
2015-02-10 20:59:27,964 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:27,965 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:27,965 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:27,966 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...latform/-1_VALUES_REPLACE
2015-02-10 20:59:27,967 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:27,968 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:27,994 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:28,013 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:28,028 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1967334461_0014
2015-02-10 20:59:28,047 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1967334461/.staging/job_local1967334461_0014/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:28,048 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1967334461/.staging/job_local1967334461_0014/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:28,097 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1967334461_0014/job_local1967334461_0014.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:28,098 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1967334461_0014/job_local1967334461_0014.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:28,099 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:28,100 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:28,101 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:28,100 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1967334461_0014
2015-02-10 20:59:28,102 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:28,103 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:28,103 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1967334461_0014_m_000000_0
2015-02-10 20:59:28,105 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:28,107 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:28,107 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@585353c8
2015-02-10 20:59:28,108 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:28,109 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:28,252 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:28,253 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:28,253 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:28,253 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:28,254 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:28,255 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:28,255 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:28,262 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:28,263 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:28,267 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:28,267 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:28,267 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:28,268 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:28,268 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:28,272 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:28,273 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1967334461_0014_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:28,276 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:28,276 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1967334461_0014_m_000000_0' done.
2015-02-10 20:59:28,276 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1967334461_0014_m_000000_0
2015-02-10 20:59:28,277 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:28,278 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:28,278 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1967334461_0014_r_000000_0
2015-02-10 20:59:28,280 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:28,280 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@5bc5d0e0
2015-02-10 20:59:28,281 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:28,282 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1967334461_0014_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:28,284 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#14 about to shuffle output of map attempt_local1967334461_0014_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:28,285 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1967334461_0014_m_000000_0
2015-02-10 20:59:28,285 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:28,286 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:28,287 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:28,287 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:28,290 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:28,290 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:28,292 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:28,292 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:28,293 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:28,293 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:28,293 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:28,294 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:28,295 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:28,295 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:28,302 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:28,302 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_REPLACE"]
2015-02-10 20:59:28,311 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:28,312 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:28,314 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1967334461_0014
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:28,316 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local1967334461_0014 state at FAILED
2015-02-10 20:59:28,316 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 20:59:28,316 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 20:59:28,316 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 20:59:28,323 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 20:59:28,323 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...latform/-1_VALUES_REPLACE
2015-02-10 20:59:28,324 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 20:59:28,324 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_REPLACE/_temporary
2015-02-10 20:59:28,324 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_REPLACE
2015-02-10 20:59:28,342 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:28,342 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:28,350 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:28,351 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:28,352 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:28,356 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:28,357 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:28,357 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_SWAP"]
2015-02-10 20:59:28,357 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:28,357 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:28,357 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:28,358 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...lyplatform/-1_VALUES_SWAP
2015-02-10 20:59:28,358 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:28,359 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:28,383 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:28,401 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:28,416 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1713309805_0015
2015-02-10 20:59:28,434 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1713309805/.staging/job_local1713309805_0015/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:28,435 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1713309805/.staging/job_local1713309805_0015/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:28,482 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1713309805_0015/job_local1713309805_0015.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:28,483 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1713309805_0015/job_local1713309805_0015.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:28,484 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:28,485 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:28,485 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:28,485 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1713309805_0015
2015-02-10 20:59:28,485 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:28,487 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:28,488 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1713309805_0015_m_000000_0
2015-02-10 20:59:28,489 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:28,491 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:28,491 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@6810a098
2015-02-10 20:59:28,492 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:28,492 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:28,758 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:28,759 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:28,759 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:28,759 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:28,759 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:28,760 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:28,760 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:28,767 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:28,767 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:28,771 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:28,772 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:28,772 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:28,772 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:28,772 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:28,775 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:28,777 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1713309805_0015_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:28,779 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:28,779 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1713309805_0015_m_000000_0' done.
2015-02-10 20:59:28,779 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1713309805_0015_m_000000_0
2015-02-10 20:59:28,780 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:28,780 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:28,780 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1713309805_0015_r_000000_0
2015-02-10 20:59:28,782 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:28,782 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@2210a0e
2015-02-10 20:59:28,783 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:28,784 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1713309805_0015_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:28,786 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#15 about to shuffle output of map attempt_local1713309805_0015_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:28,786 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1713309805_0015_m_000000_0
2015-02-10 20:59:28,786 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:28,787 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:28,788 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:28,789 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:28,791 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:28,791 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:28,792 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:28,793 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:28,793 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:28,793 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:28,796 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:28,798 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:28,798 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:28,798 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:28,805 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:28,806 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_SWAP"]
2015-02-10 20:59:28,814 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:28,815 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:28,817 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1713309805_0015
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:28,823 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local1713309805_0015 state at FAILED
2015-02-10 20:59:28,823 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 20:59:28,823 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 20:59:28,824 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 20:59:28,829 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 20:59:28,830 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...lyplatform/-1_VALUES_SWAP
2015-02-10 20:59:28,831 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 20:59:28,831 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_SWAP/_temporary
2015-02-10 20:59:28,831 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_SWAP
2015-02-10 20:59:28,849 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:28,849 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:28,857 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:28,859 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:28,859 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:28,864 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:28,864 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:28,864 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_-1"]
2015-02-10 20:59:28,864 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:28,865 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:28,865 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:28,866 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...semblyplatform/-1_ARGS_-1
2015-02-10 20:59:28,867 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:28,868 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:28,895 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:28,914 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:28,930 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1738851200_0016
2015-02-10 20:59:28,950 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1738851200/.staging/job_local1738851200_0016/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:28,950 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1738851200/.staging/job_local1738851200_0016/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:29,002 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1738851200_0016/job_local1738851200_0016.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:29,002 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1738851200_0016/job_local1738851200_0016.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:29,003 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:29,004 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1738851200_0016
2015-02-10 20:59:29,005 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:29,004 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:29,005 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:29,008 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:29,008 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1738851200_0016_m_000000_0
2015-02-10 20:59:29,010 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:29,012 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:29,012 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@15a08be5
2015-02-10 20:59:29,013 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:29,014 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:29,165 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:29,165 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:29,165 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:29,166 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:29,166 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:29,168 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:29,168 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:29,175 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:29,175 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:29,179 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:29,179 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:29,179 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:29,179 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:29,179 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:29,183 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:29,185 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1738851200_0016_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:29,187 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:29,187 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1738851200_0016_m_000000_0' done.
2015-02-10 20:59:29,187 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1738851200_0016_m_000000_0
2015-02-10 20:59:29,187 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:29,188 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:29,188 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1738851200_0016_r_000000_0
2015-02-10 20:59:29,190 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:29,190 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@7c8e3f75
2015-02-10 20:59:29,191 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:29,192 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1738851200_0016_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:29,194 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#16 about to shuffle output of map attempt_local1738851200_0016_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:29,195 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1738851200_0016_m_000000_0
2015-02-10 20:59:29,195 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:29,196 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:29,197 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:29,197 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:29,201 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:29,201 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:29,203 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:29,204 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:29,204 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:29,204 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:29,205 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:29,205 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:29,206 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:29,206 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:29,213 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:29,213 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_-1"]
2015-02-10 20:59:29,226 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1738851200_0016_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:29,228 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:29,228 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local1738851200_0016_r_000000_0 is allowed to commit now
2015-02-10 20:59:29,229 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1738851200_0016_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_-1/_temporary/0/task_local1738851200_0016_r_000000
2015-02-10 20:59:29,230 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:29,230 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1738851200_0016_r_000000_0' done.
2015-02-10 20:59:29,230 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1738851200_0016_r_000000_0
2015-02-10 20:59:29,230 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:29,245 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_-1/_temporary
2015-02-10 20:59:29,276 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:29,308 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:29,309 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_-1
2015-02-10 20:59:29,326 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:29,327 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:29,333 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_'field'
2015-02-10 20:59:29,351 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:29,351 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:29,359 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:29,361 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:29,361 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:29,366 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:29,366 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:29,366 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_RESULTS"]
2015-02-10 20:59:29,366 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:29,366 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:29,367 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:29,367 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...yplatform/-1_ARGS_RESULTS
2015-02-10 20:59:29,368 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:29,369 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:29,395 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:29,413 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:29,428 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1569438270_0017
2015-02-10 20:59:29,446 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1569438270/.staging/job_local1569438270_0017/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:29,446 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1569438270/.staging/job_local1569438270_0017/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:29,502 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1569438270_0017/job_local1569438270_0017.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:29,502 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1569438270_0017/job_local1569438270_0017.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:29,504 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:29,505 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:29,505 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:29,505 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1569438270_0017
2015-02-10 20:59:29,506 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:29,508 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:29,508 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1569438270_0017_m_000000_0
2015-02-10 20:59:29,510 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:29,512 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:29,512 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@30c2ea0b
2015-02-10 20:59:29,513 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:29,513 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:29,667 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:29,668 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:29,668 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:29,668 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:29,668 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:29,669 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:29,669 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:29,677 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:29,678 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:29,682 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:29,682 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:29,682 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:29,682 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:29,682 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:29,686 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:29,688 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1569438270_0017_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:29,690 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:29,690 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1569438270_0017_m_000000_0' done.
2015-02-10 20:59:29,690 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1569438270_0017_m_000000_0
2015-02-10 20:59:29,690 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:29,691 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:29,691 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1569438270_0017_r_000000_0
2015-02-10 20:59:29,693 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:29,693 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@2f971f66
2015-02-10 20:59:29,695 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:29,696 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1569438270_0017_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:29,697 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#17 about to shuffle output of map attempt_local1569438270_0017_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:29,698 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1569438270_0017_m_000000_0
2015-02-10 20:59:29,698 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:29,699 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:29,700 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:29,700 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:29,703 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:29,703 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:29,704 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:29,705 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:29,705 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:29,705 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:29,706 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:29,706 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:29,707 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:29,707 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:29,714 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:29,714 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_RESULTS"]
2015-02-10 20:59:29,728 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1569438270_0017_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:29,730 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:29,730 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local1569438270_0017_r_000000_0 is allowed to commit now
2015-02-10 20:59:29,731 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1569438270_0017_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_RESULTS/_temporary/0/task_local1569438270_0017_r_000000
2015-02-10 20:59:29,732 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:29,732 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1569438270_0017_r_000000_0' done.
2015-02-10 20:59:29,732 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1569438270_0017_r_000000_0
2015-02-10 20:59:29,733 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:29,761 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_RESULTS/_temporary
2015-02-10 20:59:29,792 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:29,822 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:29,824 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_RESULTS
2015-02-10 20:59:29,840 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:29,840 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:29,847 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_ALL
2015-02-10 20:59:29,863 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:29,864 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:29,870 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:29,872 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:29,872 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:29,877 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:29,877 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:29,877 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_REPLACE"]
2015-02-10 20:59:29,878 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:29,878 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:29,878 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:29,878 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...yplatform/-1_ARGS_REPLACE
2015-02-10 20:59:29,879 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:29,880 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:29,904 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:29,922 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:29,937 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local2021745132_0018
2015-02-10 20:59:29,954 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity2021745132/.staging/job_local2021745132_0018/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:29,955 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity2021745132/.staging/job_local2021745132_0018/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:30,005 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2021745132_0018/job_local2021745132_0018.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:30,006 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2021745132_0018/job_local2021745132_0018.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:30,008 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:30,008 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:30,009 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:30,008 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local2021745132_0018
2015-02-10 20:59:30,010 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:30,011 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:30,011 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local2021745132_0018_m_000000_0
2015-02-10 20:59:30,013 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:30,014 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:30,014 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@33ff9a48
2015-02-10 20:59:30,015 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:30,016 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:30,158 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:30,158 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:30,159 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:30,159 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:30,159 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:30,160 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:30,160 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:30,167 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:30,167 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:30,171 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:30,171 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:30,172 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:30,172 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:30,172 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:30,175 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:30,177 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local2021745132_0018_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:30,179 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:30,180 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local2021745132_0018_m_000000_0' done.
2015-02-10 20:59:30,180 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local2021745132_0018_m_000000_0
2015-02-10 20:59:30,180 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:30,181 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:30,181 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local2021745132_0018_r_000000_0
2015-02-10 20:59:30,183 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:30,183 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@523bd44c
2015-02-10 20:59:30,184 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:30,185 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local2021745132_0018_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:30,187 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#18 about to shuffle output of map attempt_local2021745132_0018_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:30,187 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local2021745132_0018_m_000000_0
2015-02-10 20:59:30,187 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:30,188 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:30,189 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:30,190 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:30,192 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:30,192 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:30,194 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:30,194 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:30,195 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:30,195 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:30,195 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:30,196 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:30,197 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:30,197 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:30,203 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:30,204 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_REPLACE"]
2015-02-10 20:59:30,216 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local2021745132_0018_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:30,218 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:30,218 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local2021745132_0018_r_000000_0 is allowed to commit now
2015-02-10 20:59:30,219 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local2021745132_0018_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_REPLACE/_temporary/0/task_local2021745132_0018_r_000000
2015-02-10 20:59:30,220 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:30,221 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local2021745132_0018_r_000000_0' done.
2015-02-10 20:59:30,221 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local2021745132_0018_r_000000_0
2015-02-10 20:59:30,221 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:30,240 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_REPLACE/_temporary
2015-02-10 20:59:30,269 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:30,300 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:30,302 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_REPLACE
2015-02-10 20:59:30,318 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:30,319 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:30,325 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:30,327 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:30,327 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:30,331 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:30,332 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:30,332 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_SWAP"]
2015-02-10 20:59:30,333 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:30,333 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:30,333 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:30,334 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...mblyplatform/-1_ARGS_SWAP
2015-02-10 20:59:30,335 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:30,336 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:30,360 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:30,379 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:30,396 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1949455360_0019
2015-02-10 20:59:30,418 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1949455360/.staging/job_local1949455360_0019/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:30,418 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1949455360/.staging/job_local1949455360_0019/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:30,475 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1949455360_0019/job_local1949455360_0019.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:30,476 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1949455360_0019/job_local1949455360_0019.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:30,478 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:30,478 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:30,479 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:30,479 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1949455360_0019
2015-02-10 20:59:30,479 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:30,482 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:30,482 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1949455360_0019_m_000000_0
2015-02-10 20:59:30,484 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:30,485 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:30,485 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@70398f3c
2015-02-10 20:59:30,487 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:30,487 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:30,511 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:30,512 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:30,512 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:30,512 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:30,512 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:30,513 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:30,514 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:30,520 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:30,520 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:30,524 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:30,524 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:30,524 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:30,525 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:30,525 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:30,528 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:30,530 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1949455360_0019_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:30,531 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:30,532 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1949455360_0019_m_000000_0' done.
2015-02-10 20:59:30,532 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1949455360_0019_m_000000_0
2015-02-10 20:59:30,532 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:30,533 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:30,533 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1949455360_0019_r_000000_0
2015-02-10 20:59:30,534 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:30,535 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@46844c3d
2015-02-10 20:59:30,535 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:30,536 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1949455360_0019_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:30,538 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#19 about to shuffle output of map attempt_local1949455360_0019_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:30,538 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1949455360_0019_m_000000_0
2015-02-10 20:59:30,539 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:30,539 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:30,540 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:30,540 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:30,544 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:30,545 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:30,546 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:30,547 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:30,547 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:30,548 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:30,548 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:30,549 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:30,550 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:30,550 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:30,557 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:30,557 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_SWAP"]
2015-02-10 20:59:30,571 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1949455360_0019_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:30,573 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:30,573 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local1949455360_0019_r_000000_0 is allowed to commit now
2015-02-10 20:59:30,574 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1949455360_0019_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_SWAP/_temporary/0/task_local1949455360_0019_r_000000
2015-02-10 20:59:30,575 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:30,576 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1949455360_0019_r_000000_0' done.
2015-02-10 20:59:30,576 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1949455360_0019_r_000000_0
2015-02-10 20:59:30,576 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:30,601 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_SWAP/_temporary
2015-02-10 20:59:30,635 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:30,670 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:30,671 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_SWAP
2015-02-10 20:59:30,694 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:30,694 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:30,703 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:30,706 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:30,707 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:30,711 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:30,711 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:30,711 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_-1"]
2015-02-10 20:59:30,712 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:30,712 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:30,712 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:30,712 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...mblyplatform/0_'field'_-1
2015-02-10 20:59:30,713 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:30,715 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:30,739 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:30,759 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:30,779 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local447156619_0020
2015-02-10 20:59:30,801 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity447156619/.staging/job_local447156619_0020/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:30,801 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity447156619/.staging/job_local447156619_0020/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:30,861 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local447156619_0020/job_local447156619_0020.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:30,861 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local447156619_0020/job_local447156619_0020.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:30,863 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:30,863 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:30,864 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:30,863 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local447156619_0020
2015-02-10 20:59:30,864 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:30,866 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:30,866 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local447156619_0020_m_000000_0
2015-02-10 20:59:30,868 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:30,869 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:30,869 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@22ddcabb
2015-02-10 20:59:30,870 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:30,871 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:30,894 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:30,894 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:30,894 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:30,894 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:30,895 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:30,896 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:30,896 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:30,902 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:30,903 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:30,906 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:30,906 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:30,906 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:30,906 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:30,907 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:30,910 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:30,911 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local447156619_0020_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:30,913 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:30,913 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local447156619_0020_m_000000_0' done.
2015-02-10 20:59:30,914 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local447156619_0020_m_000000_0
2015-02-10 20:59:30,914 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:30,915 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:30,915 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local447156619_0020_r_000000_0
2015-02-10 20:59:30,917 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:30,917 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@1afdc98d
2015-02-10 20:59:30,918 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=508939456, maxSingleShuffleLimit=127234864, mergeThreshold=335900064, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:30,919 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local447156619_0020_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:30,921 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#20 about to shuffle output of map attempt_local447156619_0020_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:30,921 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local447156619_0020_m_000000_0
2015-02-10 20:59:30,922 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:30,922 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:30,924 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:30,924 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:30,927 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:30,928 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:30,930 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:30,930 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:30,931 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:30,931 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:30,931 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:30,932 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:30,932 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:30,932 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:30,939 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:30,939 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_-1"]
2015-02-10 20:59:30,952 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local447156619_0020_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:30,954 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:30,954 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local447156619_0020_r_000000_0 is allowed to commit now
2015-02-10 20:59:30,955 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local447156619_0020_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_-1/_temporary/0/task_local447156619_0020_r_000000
2015-02-10 20:59:30,956 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:30,956 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local447156619_0020_r_000000_0' done.
2015-02-10 20:59:30,956 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local447156619_0020_r_000000_0
2015-02-10 20:59:30,957 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:30,972 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_-1/_temporary
2015-02-10 20:59:31,003 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:31,038 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:31,039 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_'field'_-1
2015-02-10 20:59:31,060 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:31,061 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:31,068 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:31,071 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:31,071 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:31,076 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:31,076 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:31,076 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_'field'"]
2015-02-10 20:59:31,076 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:31,076 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:31,077 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:31,079 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...latform/0_'field'_'field'
2015-02-10 20:59:31,079 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:31,080 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:31,104 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:31,123 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:31,141 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1653969750_0021
2015-02-10 20:59:31,163 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1653969750/.staging/job_local1653969750_0021/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:31,163 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1653969750/.staging/job_local1653969750_0021/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:31,225 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1653969750_0021/job_local1653969750_0021.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:31,225 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1653969750_0021/job_local1653969750_0021.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:31,227 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:31,227 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1653969750_0021
2015-02-10 20:59:31,227 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:31,227 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:31,228 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:31,231 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:31,231 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1653969750_0021_m_000000_0
2015-02-10 20:59:31,233 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:31,235 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:31,235 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@264b898
2015-02-10 20:59:31,236 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:31,236 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:31,268 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:31,268 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:31,268 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:31,268 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:31,269 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:31,270 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:31,270 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:31,276 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:31,277 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:31,281 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:31,281 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:31,281 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:31,281 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:31,281 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:31,284 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:31,286 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1653969750_0021_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:31,288 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:31,288 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1653969750_0021_m_000000_0' done.
2015-02-10 20:59:31,289 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1653969750_0021_m_000000_0
2015-02-10 20:59:31,289 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:31,289 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:31,290 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1653969750_0021_r_000000_0
2015-02-10 20:59:31,292 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:31,292 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@3f4c428f
2015-02-10 20:59:31,293 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=510728608, maxSingleShuffleLimit=127682152, mergeThreshold=337080896, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:31,294 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1653969750_0021_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:31,296 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#21 about to shuffle output of map attempt_local1653969750_0021_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:31,296 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1653969750_0021_m_000000_0
2015-02-10 20:59:31,296 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:31,297 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:31,298 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:31,300 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:31,302 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:31,303 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:31,304 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:31,305 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:31,305 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:31,306 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:31,306 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:31,307 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:31,308 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:31,308 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:31,314 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:31,314 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_'field'"]
2015-02-10 20:59:31,327 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1653969750_0021_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:31,329 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:31,329 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local1653969750_0021_r_000000_0 is allowed to commit now
2015-02-10 20:59:31,330 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1653969750_0021_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_'field'/_temporary/0/task_local1653969750_0021_r_000000
2015-02-10 20:59:31,331 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:31,331 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1653969750_0021_r_000000_0' done.
2015-02-10 20:59:31,332 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1653969750_0021_r_000000_0
2015-02-10 20:59:31,332 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:31,355 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_'field'/_temporary
2015-02-10 20:59:31,385 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:31,418 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:31,420 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_'field'_'field'
2015-02-10 20:59:31,436 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:31,437 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:31,444 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:31,445 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:31,446 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:31,450 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:31,450 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:31,450 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_RESULTS"]
2015-02-10 20:59:31,451 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:31,451 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:31,451 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:31,452 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...latform/0_'field'_RESULTS
2015-02-10 20:59:31,453 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:31,454 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:31,478 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:31,497 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:31,513 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local296655755_0022
2015-02-10 20:59:31,534 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity296655755/.staging/job_local296655755_0022/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:31,534 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity296655755/.staging/job_local296655755_0022/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:31,592 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local296655755_0022/job_local296655755_0022.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:31,593 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local296655755_0022/job_local296655755_0022.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:31,594 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:31,595 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local296655755_0022
2015-02-10 20:59:31,595 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:31,595 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:31,595 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:31,714 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:31,714 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local296655755_0022_m_000000_0
2015-02-10 20:59:31,716 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:31,717 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:31,718 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@1a3580ab
2015-02-10 20:59:31,719 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:31,719 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:31,748 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:31,749 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:31,749 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:31,749 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:31,749 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:31,750 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:31,751 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:31,757 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:31,758 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:31,762 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:31,762 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:31,762 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:31,762 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:31,762 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:31,765 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:31,767 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local296655755_0022_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:31,769 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:31,770 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local296655755_0022_m_000000_0' done.
2015-02-10 20:59:31,770 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local296655755_0022_m_000000_0
2015-02-10 20:59:31,770 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:31,770 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:31,771 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local296655755_0022_r_000000_0
2015-02-10 20:59:31,772 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:31,772 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@170fbe75
2015-02-10 20:59:31,773 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=546832384, maxSingleShuffleLimit=136708096, mergeThreshold=360909376, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:31,774 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local296655755_0022_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:31,775 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#22 about to shuffle output of map attempt_local296655755_0022_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:31,776 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local296655755_0022_m_000000_0
2015-02-10 20:59:31,776 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:31,777 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:31,778 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:31,778 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:31,781 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:31,781 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:31,784 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:31,784 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:31,784 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:31,784 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:31,785 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:31,786 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:31,786 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:31,786 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:31,792 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:31,792 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_RESULTS"]
2015-02-10 20:59:31,805 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local296655755_0022_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:31,806 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:31,806 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local296655755_0022_r_000000_0 is allowed to commit now
2015-02-10 20:59:31,807 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local296655755_0022_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_RESULTS/_temporary/0/task_local296655755_0022_r_000000
2015-02-10 20:59:31,808 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:31,808 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local296655755_0022_r_000000_0' done.
2015-02-10 20:59:31,809 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local296655755_0022_r_000000_0
2015-02-10 20:59:31,809 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:31,825 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_RESULTS/_temporary
2015-02-10 20:59:31,850 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:31,856 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:31,885 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:31,887 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_'field'_RESULTS
2015-02-10 20:59:31,905 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:31,906 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:31,913 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:31,915 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:31,916 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:31,921 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:31,921 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:31,921 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_ALL"]
2015-02-10 20:59:31,921 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:31,921 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:31,921 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:31,922 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...blyplatform/0_'field'_ALL
2015-02-10 20:59:31,923 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:31,924 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:31,947 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:31,965 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:31,982 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local78520465_0023
2015-02-10 20:59:32,000 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity78520465/.staging/job_local78520465_0023/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:32,000 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity78520465/.staging/job_local78520465_0023/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:32,048 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local78520465_0023/job_local78520465_0023.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:32,048 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local78520465_0023/job_local78520465_0023.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:32,049 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:32,050 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local78520465_0023
2015-02-10 20:59:32,050 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:32,050 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:32,050 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:32,053 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:32,053 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local78520465_0023_m_000000_0
2015-02-10 20:59:32,055 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:32,056 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:32,057 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@2a51b326
2015-02-10 20:59:32,058 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:32,058 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:32,087 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:32,088 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:32,088 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:32,088 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:32,089 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:32,090 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:32,090 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:32,096 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:32,097 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:32,100 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:32,101 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:32,101 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:32,101 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:32,102 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:32,105 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:32,107 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local78520465_0023_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:32,109 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:32,109 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local78520465_0023_m_000000_0' done.
2015-02-10 20:59:32,109 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local78520465_0023_m_000000_0
2015-02-10 20:59:32,110 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:32,110 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:32,111 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local78520465_0023_r_000000_0
2015-02-10 20:59:32,112 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:32,113 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@69dc7a0d
2015-02-10 20:59:32,113 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=549309632, maxSingleShuffleLimit=137327408, mergeThreshold=362544384, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:32,114 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local78520465_0023_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:32,116 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#23 about to shuffle output of map attempt_local78520465_0023_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:32,117 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local78520465_0023_m_000000_0
2015-02-10 20:59:32,117 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:32,118 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:32,120 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:32,120 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:32,122 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:32,122 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:32,124 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:32,124 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:32,125 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:32,125 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:32,126 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:32,127 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:32,127 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:32,127 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:32,133 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:32,134 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_ALL"]
2015-02-10 20:59:32,148 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local78520465_0023_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:32,149 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:32,149 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local78520465_0023_r_000000_0 is allowed to commit now
2015-02-10 20:59:32,150 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local78520465_0023_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_ALL/_temporary/0/task_local78520465_0023_r_000000
2015-02-10 20:59:32,152 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:32,152 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local78520465_0023_r_000000_0' done.
2015-02-10 20:59:32,152 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local78520465_0023_r_000000_0
2015-02-10 20:59:32,152 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:32,175 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_ALL/_temporary
2015-02-10 20:59:32,205 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:32,237 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:32,239 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_'field'_ALL
2015-02-10 20:59:32,257 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:32,258 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:32,263 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_'field'_REPLACE
2015-02-10 20:59:32,280 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:32,281 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:32,287 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:32,290 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:32,291 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:32,295 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:32,295 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:32,295 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_SWAP"]
2015-02-10 20:59:32,295 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:32,295 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:32,296 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:32,296 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...lyplatform/0_'field'_SWAP
2015-02-10 20:59:32,297 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:32,298 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:32,322 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:32,340 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:32,355 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local2137655569_0024
2015-02-10 20:59:32,372 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity2137655569/.staging/job_local2137655569_0024/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:32,372 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity2137655569/.staging/job_local2137655569_0024/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:32,418 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2137655569_0024/job_local2137655569_0024.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:32,418 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2137655569_0024/job_local2137655569_0024.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:32,420 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:32,420 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local2137655569_0024
2015-02-10 20:59:32,420 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:32,420 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:32,420 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:32,423 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:32,423 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local2137655569_0024_m_000000_0
2015-02-10 20:59:32,425 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:32,426 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:32,426 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@17894800
2015-02-10 20:59:32,428 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:32,428 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:32,457 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:32,457 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:32,457 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:32,457 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:32,457 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:32,459 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:32,459 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:32,467 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:32,467 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:32,471 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:32,471 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:32,471 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:32,471 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:32,471 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:32,475 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:32,476 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local2137655569_0024_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:32,478 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:32,478 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local2137655569_0024_m_000000_0' done.
2015-02-10 20:59:32,479 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local2137655569_0024_m_000000_0
2015-02-10 20:59:32,479 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:32,480 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:32,480 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local2137655569_0024_r_000000_0
2015-02-10 20:59:32,481 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:32,482 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@329e2e50
2015-02-10 20:59:32,482 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=551786880, maxSingleShuffleLimit=137946720, mergeThreshold=364179360, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:32,483 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local2137655569_0024_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:32,485 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#24 about to shuffle output of map attempt_local2137655569_0024_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:32,485 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local2137655569_0024_m_000000_0
2015-02-10 20:59:32,485 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:32,486 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:32,488 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:32,488 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:32,490 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:32,491 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:32,492 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:32,492 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:32,493 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:32,493 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:32,493 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:32,494 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:32,494 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:32,494 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:32,500 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:32,500 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_SWAP"]
2015-02-10 20:59:32,512 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local2137655569_0024_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:32,514 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:32,514 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local2137655569_0024_r_000000_0 is allowed to commit now
2015-02-10 20:59:32,514 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local2137655569_0024_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_SWAP/_temporary/0/task_local2137655569_0024_r_000000
2015-02-10 20:59:32,516 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:32,516 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local2137655569_0024_r_000000_0' done.
2015-02-10 20:59:32,516 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local2137655569_0024_r_000000_0
2015-02-10 20:59:32,516 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:32,533 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_SWAP/_temporary
2015-02-10 20:59:32,563 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:32,593 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:32,594 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_'field'_SWAP
2015-02-10 20:59:32,612 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:32,613 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:32,619 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:32,620 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:32,621 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:32,625 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:32,625 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:32,625 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_-1"]
2015-02-10 20:59:32,625 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:32,626 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:32,626 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:32,626 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...mblyplatform/0_UNKNOWN_-1
2015-02-10 20:59:32,627 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:32,628 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:32,652 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:32,670 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:32,684 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local284948507_0025
2015-02-10 20:59:32,701 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity284948507/.staging/job_local284948507_0025/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:32,701 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity284948507/.staging/job_local284948507_0025/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:32,745 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local284948507_0025/job_local284948507_0025.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:32,746 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local284948507_0025/job_local284948507_0025.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:32,747 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:32,747 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local284948507_0025
2015-02-10 20:59:32,747 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:32,747 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:32,747 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:32,750 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:32,750 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local284948507_0025_m_000000_0
2015-02-10 20:59:32,752 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:32,753 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:32,753 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@70038599
2015-02-10 20:59:32,755 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:32,755 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:32,783 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:32,784 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:32,784 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:32,784 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:32,784 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:32,785 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:32,785 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:32,791 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:32,791 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:32,795 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:32,795 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:32,795 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:32,795 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:32,795 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:32,799 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:32,800 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local284948507_0025_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:32,802 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:32,803 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local284948507_0025_m_000000_0' done.
2015-02-10 20:59:32,803 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local284948507_0025_m_000000_0
2015-02-10 20:59:32,803 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:32,803 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:32,804 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local284948507_0025_r_000000_0
2015-02-10 20:59:32,806 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:32,806 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@6d116cae
2015-02-10 20:59:32,806 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=551970368, maxSingleShuffleLimit=137992592, mergeThreshold=364300448, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:32,807 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local284948507_0025_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:32,809 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#25 about to shuffle output of map attempt_local284948507_0025_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:32,809 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local284948507_0025_m_000000_0
2015-02-10 20:59:32,810 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:32,810 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:32,811 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:32,812 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:32,817 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:32,817 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:32,819 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:32,820 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:32,820 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:32,821 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:32,821 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:32,822 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:32,823 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:32,823 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:32,830 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:32,830 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_-1"]
2015-02-10 20:59:32,843 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local284948507_0025_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:32,844 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:32,845 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local284948507_0025_r_000000_0 is allowed to commit now
2015-02-10 20:59:32,846 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local284948507_0025_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_-1/_temporary/0/task_local284948507_0025_r_000000
2015-02-10 20:59:32,847 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:32,847 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local284948507_0025_r_000000_0' done.
2015-02-10 20:59:32,848 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local284948507_0025_r_000000_0
2015-02-10 20:59:32,848 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:32,870 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_-1/_temporary
2015-02-10 20:59:32,898 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:32,932 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:32,933 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_-1
2015-02-10 20:59:32,949 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:32,949 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:32,954 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_'field'
2015-02-10 20:59:32,969 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:32,970 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:32,975 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:32,977 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:32,978 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:32,982 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:32,982 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:32,982 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_RESULTS"]
2015-02-10 20:59:32,982 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:32,982 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:32,982 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:32,984 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...latform/0_UNKNOWN_RESULTS
2015-02-10 20:59:32,985 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:32,987 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:33,010 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:33,028 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:33,043 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1247097328_0026
2015-02-10 20:59:33,054 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:33,061 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1247097328/.staging/job_local1247097328_0026/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:33,061 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1247097328/.staging/job_local1247097328_0026/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:33,106 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1247097328_0026/job_local1247097328_0026.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:33,107 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1247097328_0026/job_local1247097328_0026.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:33,108 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:33,108 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1247097328_0026
2015-02-10 20:59:33,108 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:33,108 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:33,109 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:33,111 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:33,112 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1247097328_0026_m_000000_0
2015-02-10 20:59:33,113 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:33,114 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:33,114 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@3c407d5
2015-02-10 20:59:33,115 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:33,116 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:33,144 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:33,144 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:33,144 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:33,145 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:33,145 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:33,146 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:33,146 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:33,152 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:33,152 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:33,155 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:33,155 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:33,156 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:33,156 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:33,156 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:33,159 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:33,160 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1247097328_0026_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:33,162 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:33,162 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1247097328_0026_m_000000_0' done.
2015-02-10 20:59:33,162 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1247097328_0026_m_000000_0
2015-02-10 20:59:33,163 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:33,163 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:33,163 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1247097328_0026_r_000000_0
2015-02-10 20:59:33,165 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:33,165 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@422b2fec
2015-02-10 20:59:33,166 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552016256, maxSingleShuffleLimit=138004064, mergeThreshold=364330752, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:33,167 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1247097328_0026_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:33,168 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#26 about to shuffle output of map attempt_local1247097328_0026_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:33,169 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1247097328_0026_m_000000_0
2015-02-10 20:59:33,169 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:33,170 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:33,171 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:33,171 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:33,173 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:33,173 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:33,175 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:33,175 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:33,175 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:33,176 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:33,176 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:33,177 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:33,178 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:33,178 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:33,184 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:33,185 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_RESULTS"]
2015-02-10 20:59:33,197 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1247097328_0026_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:33,199 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:33,199 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local1247097328_0026_r_000000_0 is allowed to commit now
2015-02-10 20:59:33,200 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1247097328_0026_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_RESULTS/_temporary/0/task_local1247097328_0026_r_000000
2015-02-10 20:59:33,201 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:33,202 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1247097328_0026_r_000000_0' done.
2015-02-10 20:59:33,202 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1247097328_0026_r_000000_0
2015-02-10 20:59:33,202 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:33,221 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_RESULTS/_temporary
2015-02-10 20:59:33,250 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:33,280 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:33,281 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_RESULTS
2015-02-10 20:59:33,297 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:33,297 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:33,303 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:33,304 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:33,305 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:33,308 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:33,309 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:33,309 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_ALL"]
2015-02-10 20:59:33,309 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:33,309 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:33,309 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:33,310 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...blyplatform/0_UNKNOWN_ALL
2015-02-10 20:59:33,310 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:33,311 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:33,334 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:33,352 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:33,366 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1674002121_0027
2015-02-10 20:59:33,383 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1674002121/.staging/job_local1674002121_0027/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:33,383 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1674002121/.staging/job_local1674002121_0027/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:33,428 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1674002121_0027/job_local1674002121_0027.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:33,428 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1674002121_0027/job_local1674002121_0027.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:33,429 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:33,429 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1674002121_0027
2015-02-10 20:59:33,430 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:33,430 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:33,430 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:33,433 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:33,433 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1674002121_0027_m_000000_0
2015-02-10 20:59:33,434 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:33,435 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:33,436 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@56dee1b4
2015-02-10 20:59:33,437 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:33,437 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:33,465 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:33,465 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:33,466 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:33,466 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:33,466 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:33,467 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:33,467 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:33,473 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:33,473 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:33,476 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:33,477 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:33,477 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:33,477 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:33,477 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:33,480 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:33,481 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1674002121_0027_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:33,483 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:33,483 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1674002121_0027_m_000000_0' done.
2015-02-10 20:59:33,484 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1674002121_0027_m_000000_0
2015-02-10 20:59:33,484 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:33,484 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:33,484 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1674002121_0027_r_000000_0
2015-02-10 20:59:33,486 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:33,486 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@1a0d7ed8
2015-02-10 20:59:33,487 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552153920, maxSingleShuffleLimit=138038480, mergeThreshold=364421600, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:33,488 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1674002121_0027_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:33,490 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#27 about to shuffle output of map attempt_local1674002121_0027_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:33,490 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1674002121_0027_m_000000_0
2015-02-10 20:59:33,490 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:33,491 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:33,492 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:33,492 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:33,494 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:33,495 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:33,495 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:33,496 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:33,497 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:33,497 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:33,498 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:33,498 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:33,499 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:33,499 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:33,500 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:33,505 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:33,506 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_ALL"]
2015-02-10 20:59:33,520 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1674002121_0027_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:33,521 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:33,522 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local1674002121_0027_r_000000_0 is allowed to commit now
2015-02-10 20:59:33,522 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1674002121_0027_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_ALL/_temporary/0/task_local1674002121_0027_r_000000
2015-02-10 20:59:33,524 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:33,524 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1674002121_0027_r_000000_0' done.
2015-02-10 20:59:33,524 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1674002121_0027_r_000000_0
2015-02-10 20:59:33,524 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:33,541 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_ALL/_temporary
2015-02-10 20:59:33,571 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:33,600 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:33,602 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_ALL
2015-02-10 20:59:33,617 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:33,618 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:33,623 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:33,625 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:33,626 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:33,630 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:33,630 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:33,630 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_REPLACE"]
2015-02-10 20:59:33,630 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:33,630 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:33,630 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:33,631 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...latform/0_UNKNOWN_REPLACE
2015-02-10 20:59:33,632 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:33,633 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:33,656 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:33,674 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:33,688 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1059149558_0028
2015-02-10 20:59:33,705 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1059149558/.staging/job_local1059149558_0028/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:33,705 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1059149558/.staging/job_local1059149558_0028/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:33,753 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1059149558_0028/job_local1059149558_0028.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:33,754 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1059149558_0028/job_local1059149558_0028.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:33,755 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:33,756 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1059149558_0028
2015-02-10 20:59:33,756 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:33,757 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:33,757 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:33,759 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:33,760 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1059149558_0028_m_000000_0
2015-02-10 20:59:33,761 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:33,762 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:33,763 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@7c2c0d3e
2015-02-10 20:59:33,764 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:33,764 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:33,793 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:33,794 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:33,794 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:33,794 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:33,794 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:33,795 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:33,798 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:33,804 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:33,804 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:33,808 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:33,809 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:33,809 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:33,809 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:33,809 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:33,812 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:33,814 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1059149558_0028_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:33,816 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:33,816 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1059149558_0028_m_000000_0' done.
2015-02-10 20:59:33,817 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1059149558_0028_m_000000_0
2015-02-10 20:59:33,817 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:33,818 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:33,818 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1059149558_0028_r_000000_0
2015-02-10 20:59:33,819 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:33,820 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@49fa7ba
2015-02-10 20:59:33,820 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552153920, maxSingleShuffleLimit=138038480, mergeThreshold=364421600, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:33,821 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1059149558_0028_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:33,825 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#28 about to shuffle output of map attempt_local1059149558_0028_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:33,826 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1059149558_0028_m_000000_0
2015-02-10 20:59:33,826 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:33,828 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:33,829 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:33,829 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:33,831 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:33,831 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:33,832 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:33,833 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:33,833 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:33,833 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:33,833 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:33,834 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:33,834 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:33,835 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:33,840 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:33,840 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_REPLACE"]
2015-02-10 20:59:33,848 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:33,849 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:33,851 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1059149558_0028
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:33,854 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local1059149558_0028 state at FAILED
2015-02-10 20:59:33,855 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 20:59:33,855 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 20:59:33,855 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 20:59:33,860 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 20:59:33,861 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...latform/0_UNKNOWN_REPLACE
2015-02-10 20:59:33,861 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 20:59:33,861 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_REPLACE/_temporary
2015-02-10 20:59:33,862 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_REPLACE
2015-02-10 20:59:33,878 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:33,878 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:33,879 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:33,884 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:33,886 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:33,887 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:33,890 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:33,891 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:33,891 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_SWAP"]
2015-02-10 20:59:33,891 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:33,891 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:33,891 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:33,893 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...lyplatform/0_UNKNOWN_SWAP
2015-02-10 20:59:33,893 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:33,895 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:33,918 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:33,936 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:33,951 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local412995492_0029
2015-02-10 20:59:33,967 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity412995492/.staging/job_local412995492_0029/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:33,967 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity412995492/.staging/job_local412995492_0029/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:34,012 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local412995492_0029/job_local412995492_0029.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:34,012 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local412995492_0029/job_local412995492_0029.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:34,013 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:34,013 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local412995492_0029
2015-02-10 20:59:34,013 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:34,014 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:34,014 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:34,016 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:34,017 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local412995492_0029_m_000000_0
2015-02-10 20:59:34,018 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:34,019 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:34,020 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@ed48578
2015-02-10 20:59:34,021 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:34,021 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:34,050 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:34,051 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:34,051 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:34,051 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:34,051 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:34,052 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:34,052 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:34,059 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:34,060 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:34,063 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:34,063 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:34,063 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:34,065 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:34,065 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:34,068 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:34,070 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local412995492_0029_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:34,071 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:34,071 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local412995492_0029_m_000000_0' done.
2015-02-10 20:59:34,072 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local412995492_0029_m_000000_0
2015-02-10 20:59:34,072 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:34,072 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:34,073 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local412995492_0029_r_000000_0
2015-02-10 20:59:34,074 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:34,074 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@28e1fbe3
2015-02-10 20:59:34,075 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552337408, maxSingleShuffleLimit=138084352, mergeThreshold=364542688, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:34,076 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local412995492_0029_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:34,077 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#29 about to shuffle output of map attempt_local412995492_0029_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:34,078 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local412995492_0029_m_000000_0
2015-02-10 20:59:34,078 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:34,079 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:34,081 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:34,082 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:34,083 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:34,083 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:34,085 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:34,085 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:34,085 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:34,085 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:34,086 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:34,086 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:34,087 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:34,087 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:34,092 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:34,092 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_SWAP"]
2015-02-10 20:59:34,104 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local412995492_0029_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:34,105 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:34,105 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local412995492_0029_r_000000_0 is allowed to commit now
2015-02-10 20:59:34,106 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local412995492_0029_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_SWAP/_temporary/0/task_local412995492_0029_r_000000
2015-02-10 20:59:34,107 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:34,107 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local412995492_0029_r_000000_0' done.
2015-02-10 20:59:34,108 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local412995492_0029_r_000000_0
2015-02-10 20:59:34,108 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:34,126 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_SWAP/_temporary
2015-02-10 20:59:34,155 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:34,185 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:34,187 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_SWAP
2015-02-10 20:59:34,204 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:34,205 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:34,211 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:34,213 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:34,213 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:34,217 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:34,217 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:34,218 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_-1"]
2015-02-10 20:59:34,218 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:34,218 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:34,218 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:34,219 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...emblyplatform/0_VALUES_-1
2015-02-10 20:59:34,219 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:34,221 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:34,246 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:34,263 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:34,278 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local259918524_0030
2015-02-10 20:59:34,281 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:34,295 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity259918524/.staging/job_local259918524_0030/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:34,295 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity259918524/.staging/job_local259918524_0030/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:34,341 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local259918524_0030/job_local259918524_0030.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:34,341 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local259918524_0030/job_local259918524_0030.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:34,342 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:34,343 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local259918524_0030
2015-02-10 20:59:34,343 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:34,343 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:34,344 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:34,347 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:34,347 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local259918524_0030_m_000000_0
2015-02-10 20:59:34,348 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:34,349 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:34,350 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@52ee271d
2015-02-10 20:59:34,351 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:34,351 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:34,380 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:34,380 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:34,380 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:34,380 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:34,381 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:34,382 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:34,382 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:34,388 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:34,388 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:34,391 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:34,391 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:34,391 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:34,392 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:34,392 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:34,394 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:34,396 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local259918524_0030_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:34,398 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:34,398 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local259918524_0030_m_000000_0' done.
2015-02-10 20:59:34,398 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local259918524_0030_m_000000_0
2015-02-10 20:59:34,398 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:34,399 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:34,399 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local259918524_0030_r_000000_0
2015-02-10 20:59:34,400 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:34,400 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@6015eb5a
2015-02-10 20:59:34,401 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552429120, maxSingleShuffleLimit=138107280, mergeThreshold=364603232, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:34,402 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local259918524_0030_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:34,403 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#30 about to shuffle output of map attempt_local259918524_0030_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:34,404 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local259918524_0030_m_000000_0
2015-02-10 20:59:34,404 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:34,405 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:34,406 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:34,406 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:34,408 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:34,408 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:34,409 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:34,410 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:34,410 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:34,410 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:34,410 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:34,414 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:34,414 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:34,414 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:34,419 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:34,420 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_-1"]
2015-02-10 20:59:34,428 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:34,428 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:34,430 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local259918524_0030
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:34,433 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local259918524_0030 state at FAILED
2015-02-10 20:59:34,433 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 20:59:34,433 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 20:59:34,433 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 20:59:34,438 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 20:59:34,438 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...emblyplatform/0_VALUES_-1
2015-02-10 20:59:34,439 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 20:59:34,440 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_-1/_temporary
2015-02-10 20:59:34,440 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_VALUES_-1
2015-02-10 20:59:34,456 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:34,457 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:34,461 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_VALUES_'field'
2015-02-10 20:59:34,477 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:34,477 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:34,482 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:34,484 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:34,485 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:34,488 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:34,489 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:34,489 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_RESULTS"]
2015-02-10 20:59:34,489 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:34,490 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:34,490 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:34,491 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...platform/0_VALUES_RESULTS
2015-02-10 20:59:34,491 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:34,492 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:34,516 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:34,534 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:34,549 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1546319171_0031
2015-02-10 20:59:34,566 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1546319171/.staging/job_local1546319171_0031/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:34,566 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1546319171/.staging/job_local1546319171_0031/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:34,611 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1546319171_0031/job_local1546319171_0031.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:34,611 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1546319171_0031/job_local1546319171_0031.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:34,613 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:34,613 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1546319171_0031
2015-02-10 20:59:34,613 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:34,613 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:34,614 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:34,616 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:34,616 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1546319171_0031_m_000000_0
2015-02-10 20:59:34,618 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:34,619 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:34,619 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@3936d1b4
2015-02-10 20:59:34,620 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:34,620 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:34,649 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:34,649 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:34,649 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:34,649 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:34,649 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:34,650 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:34,651 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:34,658 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:34,659 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:34,662 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:34,662 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:34,662 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:34,662 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:34,662 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:34,665 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:34,667 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1546319171_0031_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:34,668 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:34,669 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1546319171_0031_m_000000_0' done.
2015-02-10 20:59:34,669 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1546319171_0031_m_000000_0
2015-02-10 20:59:34,669 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:34,669 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:34,670 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1546319171_0031_r_000000_0
2015-02-10 20:59:34,671 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:34,671 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@5c49d589
2015-02-10 20:59:34,672 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552612672, maxSingleShuffleLimit=138153168, mergeThreshold=364724384, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:34,673 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1546319171_0031_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:34,674 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#31 about to shuffle output of map attempt_local1546319171_0031_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:34,675 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1546319171_0031_m_000000_0
2015-02-10 20:59:34,675 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:34,676 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:34,677 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:34,677 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:34,679 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:34,679 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:34,682 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:34,683 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:34,683 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:34,683 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:34,683 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:34,684 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:34,684 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:34,685 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:34,690 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:34,690 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_RESULTS"]
2015-02-10 20:59:34,698 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:34,699 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:34,701 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1546319171_0031
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:34,710 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local1546319171_0031 state at FAILED
2015-02-10 20:59:34,710 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 20:59:34,710 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 20:59:34,710 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 20:59:34,714 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 20:59:34,714 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...platform/0_VALUES_RESULTS
2015-02-10 20:59:34,715 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 20:59:34,715 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_RESULTS/_temporary
2015-02-10 20:59:34,715 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_VALUES_RESULTS
2015-02-10 20:59:34,731 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:34,732 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:34,737 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:34,739 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:34,739 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:34,743 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:34,743 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:34,743 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_ALL"]
2015-02-10 20:59:34,743 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:34,743 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:34,744 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:34,745 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...mblyplatform/0_VALUES_ALL
2015-02-10 20:59:34,746 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:34,748 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:34,772 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:34,783 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:34,790 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:34,804 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local260088328_0032
2015-02-10 20:59:34,823 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity260088328/.staging/job_local260088328_0032/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:34,823 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity260088328/.staging/job_local260088328_0032/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:34,870 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local260088328_0032/job_local260088328_0032.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:34,871 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local260088328_0032/job_local260088328_0032.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:34,872 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:34,873 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local260088328_0032
2015-02-10 20:59:34,873 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:34,873 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:34,874 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:34,877 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:34,877 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local260088328_0032_m_000000_0
2015-02-10 20:59:34,878 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:34,879 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:34,880 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@46d3d145
2015-02-10 20:59:34,881 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:34,881 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:34,910 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:34,910 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:34,910 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:34,910 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:34,911 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:34,912 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:34,912 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:34,917 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:34,917 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:34,920 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:34,920 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:34,920 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:34,920 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:34,921 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:34,923 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:34,925 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local260088328_0032_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:34,926 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:34,927 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local260088328_0032_m_000000_0' done.
2015-02-10 20:59:34,927 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local260088328_0032_m_000000_0
2015-02-10 20:59:34,927 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:34,928 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:34,928 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local260088328_0032_r_000000_0
2015-02-10 20:59:34,929 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:34,929 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@7479daf5
2015-02-10 20:59:34,930 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552612672, maxSingleShuffleLimit=138153168, mergeThreshold=364724384, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:34,931 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local260088328_0032_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:34,932 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#32 about to shuffle output of map attempt_local260088328_0032_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:34,933 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local260088328_0032_m_000000_0
2015-02-10 20:59:34,933 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:34,934 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:34,934 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:34,935 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:34,936 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:34,937 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:34,938 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:34,939 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:34,939 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:34,939 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:34,939 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:34,940 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:34,941 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:34,942 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:34,946 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:34,947 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_ALL"]
2015-02-10 20:59:34,955 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:34,956 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:34,958 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local260088328_0032
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:34,961 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local260088328_0032 state at FAILED
2015-02-10 20:59:34,962 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 20:59:34,962 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 20:59:34,962 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 20:59:34,965 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 20:59:34,966 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...mblyplatform/0_VALUES_ALL
2015-02-10 20:59:34,966 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 20:59:34,966 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] shutting down job executor
2015-02-10 20:59:34,967 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] shutdown complete
2015-02-10 20:59:34,967 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_ALL/_temporary
2015-02-10 20:59:34,967 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_VALUES_ALL
2015-02-10 20:59:34,983 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:34,984 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:34,989 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:34,991 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:34,991 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:34,995 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:34,995 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:34,995 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_REPLACE"]
2015-02-10 20:59:34,995 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:34,995 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:34,995 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:34,996 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...platform/0_VALUES_REPLACE
2015-02-10 20:59:34,997 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:34,998 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:35,020 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:35,038 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:35,052 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1705094244_0033
2015-02-10 20:59:35,069 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1705094244/.staging/job_local1705094244_0033/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:35,069 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1705094244/.staging/job_local1705094244_0033/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:35,114 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1705094244_0033/job_local1705094244_0033.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:35,114 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1705094244_0033/job_local1705094244_0033.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:35,115 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:35,116 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:35,116 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:35,116 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1705094244_0033
2015-02-10 20:59:35,117 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:35,119 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:35,119 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1705094244_0033_m_000000_0
2015-02-10 20:59:35,120 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:35,121 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:35,122 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@5fa6e5d5
2015-02-10 20:59:35,124 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:35,124 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:35,240 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:35,240 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:35,241 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:35,241 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:35,241 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:35,242 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:35,242 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:35,247 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:35,248 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:35,251 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:35,251 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:35,251 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:35,251 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:35,251 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:35,254 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:35,256 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1705094244_0033_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:35,269 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:35,269 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1705094244_0033_m_000000_0' done.
2015-02-10 20:59:35,269 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1705094244_0033_m_000000_0
2015-02-10 20:59:35,269 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:35,270 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:35,271 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1705094244_0033_r_000000_0
2015-02-10 20:59:35,272 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:35,272 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@5a62a404
2015-02-10 20:59:35,273 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552796160, maxSingleShuffleLimit=138199040, mergeThreshold=364845472, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:35,274 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1705094244_0033_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:35,275 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#33 about to shuffle output of map attempt_local1705094244_0033_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:35,276 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1705094244_0033_m_000000_0
2015-02-10 20:59:35,276 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:35,277 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:35,278 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:35,278 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:35,280 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:35,280 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:35,282 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:35,282 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:35,282 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:35,282 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:35,283 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:35,283 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:35,284 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:35,284 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:35,288 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:35,289 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_REPLACE"]
2015-02-10 20:59:35,297 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:35,297 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:35,299 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1705094244_0033
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:35,307 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local1705094244_0033 state at FAILED
2015-02-10 20:59:35,308 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 20:59:35,308 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 20:59:35,308 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 20:59:35,311 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 20:59:35,313 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...platform/0_VALUES_REPLACE
2015-02-10 20:59:35,313 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 20:59:35,313 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_REPLACE/_temporary
2015-02-10 20:59:35,314 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_VALUES_REPLACE
2015-02-10 20:59:35,330 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:35,330 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:35,335 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:35,337 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:35,337 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:35,341 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:35,341 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:35,341 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_SWAP"]
2015-02-10 20:59:35,341 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:35,341 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:35,341 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:35,343 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...blyplatform/0_VALUES_SWAP
2015-02-10 20:59:35,344 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:35,345 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:35,368 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:35,386 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:35,400 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local756711217_0034
2015-02-10 20:59:35,416 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity756711217/.staging/job_local756711217_0034/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:35,417 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity756711217/.staging/job_local756711217_0034/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:35,462 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local756711217_0034/job_local756711217_0034.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:35,463 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local756711217_0034/job_local756711217_0034.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:35,464 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:35,464 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local756711217_0034
2015-02-10 20:59:35,465 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:35,465 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:35,465 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:35,467 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:35,468 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local756711217_0034_m_000000_0
2015-02-10 20:59:35,469 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:35,470 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:35,470 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@5fa52ad1
2015-02-10 20:59:35,471 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:35,471 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:35,489 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:35,489 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:35,489 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:35,489 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:35,489 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:35,490 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:35,491 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:35,495 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:35,495 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:35,498 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:35,499 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:35,499 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:35,499 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:35,499 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:35,502 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:35,504 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local756711217_0034_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:35,506 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:35,506 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local756711217_0034_m_000000_0' done.
2015-02-10 20:59:35,506 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local756711217_0034_m_000000_0
2015-02-10 20:59:35,506 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:35,507 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:35,508 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local756711217_0034_r_000000_0
2015-02-10 20:59:35,512 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:35,512 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@1a3174f7
2015-02-10 20:59:35,512 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552796160, maxSingleShuffleLimit=138199040, mergeThreshold=364845472, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:35,513 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local756711217_0034_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:35,515 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#34 about to shuffle output of map attempt_local756711217_0034_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:35,515 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local756711217_0034_m_000000_0
2015-02-10 20:59:35,515 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:35,516 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:35,517 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:35,517 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:35,519 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:35,519 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:35,521 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:35,521 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:35,521 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:35,521 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:35,522 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:35,522 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:35,522 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:35,523 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:35,527 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:35,527 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_SWAP"]
2015-02-10 20:59:35,535 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:35,536 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:35,537 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local756711217_0034
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:35,547 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local756711217_0034 state at FAILED
2015-02-10 20:59:35,547 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 20:59:35,547 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 20:59:35,548 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 20:59:35,551 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 20:59:35,551 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...blyplatform/0_VALUES_SWAP
2015-02-10 20:59:35,552 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 20:59:35,552 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] shutting down job executor
2015-02-10 20:59:35,552 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] shutdown complete
2015-02-10 20:59:35,553 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_SWAP/_temporary
2015-02-10 20:59:35,553 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_VALUES_SWAP
2015-02-10 20:59:35,569 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:35,569 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:35,574 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:35,576 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:35,576 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:35,580 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:35,580 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:35,580 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_-1"]
2015-02-10 20:59:35,580 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:35,580 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:35,581 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:35,583 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...ssemblyplatform/0_ARGS_-1
2015-02-10 20:59:35,583 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:35,584 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:35,607 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:35,625 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:35,639 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1537999417_0035
2015-02-10 20:59:35,655 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1537999417/.staging/job_local1537999417_0035/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:35,655 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1537999417/.staging/job_local1537999417_0035/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:35,699 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1537999417_0035/job_local1537999417_0035.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:35,699 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1537999417_0035/job_local1537999417_0035.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:35,700 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:35,700 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1537999417_0035
2015-02-10 20:59:35,701 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:35,701 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:35,701 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:35,704 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:35,704 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1537999417_0035_m_000000_0
2015-02-10 20:59:35,705 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:35,707 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:35,707 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@6ea4ffc6
2015-02-10 20:59:35,708 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:35,708 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:35,736 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:35,737 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:35,737 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:35,737 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:35,737 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:35,738 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:35,738 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:35,743 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:35,743 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:35,746 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:35,746 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:35,747 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:35,747 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:35,747 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:35,750 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:35,751 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1537999417_0035_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:35,753 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:35,753 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1537999417_0035_m_000000_0' done.
2015-02-10 20:59:35,753 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1537999417_0035_m_000000_0
2015-02-10 20:59:35,753 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:35,754 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:35,754 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1537999417_0035_r_000000_0
2015-02-10 20:59:35,756 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:35,756 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@36577c06
2015-02-10 20:59:35,756 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552842048, maxSingleShuffleLimit=138210512, mergeThreshold=364875776, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:35,757 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1537999417_0035_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:35,759 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#35 about to shuffle output of map attempt_local1537999417_0035_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:35,759 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1537999417_0035_m_000000_0
2015-02-10 20:59:35,759 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:35,760 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:35,761 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:35,761 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:35,763 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:35,763 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:35,764 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:35,765 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:35,765 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:35,765 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:35,765 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:35,766 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:35,766 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:35,766 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:35,771 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:35,771 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_-1"]
2015-02-10 20:59:35,782 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1537999417_0035_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:35,783 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:35,783 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local1537999417_0035_r_000000_0 is allowed to commit now
2015-02-10 20:59:35,784 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1537999417_0035_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_-1/_temporary/0/task_local1537999417_0035_r_000000
2015-02-10 20:59:35,785 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:35,785 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1537999417_0035_r_000000_0' done.
2015-02-10 20:59:35,785 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1537999417_0035_r_000000_0
2015-02-10 20:59:35,786 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:35,801 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_-1/_temporary
2015-02-10 20:59:35,830 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:35,861 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:35,862 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_ARGS_-1
2015-02-10 20:59:35,878 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:35,878 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:35,882 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_ARGS_'field'
2015-02-10 20:59:35,898 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:35,898 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:35,904 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:35,906 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:35,907 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:35,910 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:35,910 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:35,910 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_RESULTS"]
2015-02-10 20:59:35,911 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:35,911 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:35,911 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:35,911 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...lyplatform/0_ARGS_RESULTS
2015-02-10 20:59:35,912 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:35,913 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:35,936 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:35,953 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:35,968 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1879264803_0036
2015-02-10 20:59:35,984 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1879264803/.staging/job_local1879264803_0036/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:35,984 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1879264803/.staging/job_local1879264803_0036/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:36,028 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1879264803_0036/job_local1879264803_0036.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:36,029 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1879264803_0036/job_local1879264803_0036.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:36,030 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:36,031 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:36,031 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:36,031 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1879264803_0036
2015-02-10 20:59:36,031 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:36,033 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:36,033 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1879264803_0036_m_000000_0
2015-02-10 20:59:36,035 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:36,036 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:36,036 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@64b28abf
2015-02-10 20:59:36,037 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:36,037 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:36,066 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:36,066 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:36,066 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:36,066 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:36,066 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:36,067 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:36,068 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:36,072 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:36,072 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:36,075 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:36,076 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:36,076 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:36,076 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:36,076 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:36,079 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:36,080 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1879264803_0036_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:36,082 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:36,082 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1879264803_0036_m_000000_0' done.
2015-02-10 20:59:36,082 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1879264803_0036_m_000000_0
2015-02-10 20:59:36,083 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:36,083 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:36,083 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1879264803_0036_r_000000_0
2015-02-10 20:59:36,085 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:36,085 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@14beb6
2015-02-10 20:59:36,086 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552979648, maxSingleShuffleLimit=138244912, mergeThreshold=364966592, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:36,086 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1879264803_0036_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:36,088 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#36 about to shuffle output of map attempt_local1879264803_0036_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:36,088 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1879264803_0036_m_000000_0
2015-02-10 20:59:36,088 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:36,089 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:36,090 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:36,090 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:36,092 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:36,092 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:36,094 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:36,094 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:36,094 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:36,094 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:36,095 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:36,095 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:36,095 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:36,096 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:36,100 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:36,100 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_RESULTS"]
2015-02-10 20:59:36,111 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1879264803_0036_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:36,113 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:36,113 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local1879264803_0036_r_000000_0 is allowed to commit now
2015-02-10 20:59:36,113 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1879264803_0036_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_RESULTS/_temporary/0/task_local1879264803_0036_r_000000
2015-02-10 20:59:36,114 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:36,115 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1879264803_0036_r_000000_0' done.
2015-02-10 20:59:36,115 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1879264803_0036_r_000000_0
2015-02-10 20:59:36,115 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:36,131 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_RESULTS/_temporary
2015-02-10 20:59:36,160 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:36,190 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:36,191 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_ARGS_RESULTS
2015-02-10 20:59:36,208 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:36,209 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:36,213 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_ARGS_ALL
2015-02-10 20:59:36,229 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:36,230 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:36,237 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:36,239 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:36,239 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:36,243 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:36,243 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:36,243 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_REPLACE"]
2015-02-10 20:59:36,244 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:36,244 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:36,244 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:36,244 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...lyplatform/0_ARGS_REPLACE
2015-02-10 20:59:36,245 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:36,246 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:36,269 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:36,287 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:36,301 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1339005569_0037
2015-02-10 20:59:36,318 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1339005569/.staging/job_local1339005569_0037/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:36,318 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1339005569/.staging/job_local1339005569_0037/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:36,363 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1339005569_0037/job_local1339005569_0037.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:36,363 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1339005569_0037/job_local1339005569_0037.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:36,365 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:36,365 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:36,366 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:36,365 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1339005569_0037
2015-02-10 20:59:36,367 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:36,369 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:36,370 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1339005569_0037_m_000000_0
2015-02-10 20:59:36,371 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:36,372 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:36,372 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@726b37ad
2015-02-10 20:59:36,373 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:36,374 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:36,402 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:36,402 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:36,402 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:36,402 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:36,402 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:36,404 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:36,404 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:36,409 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:36,409 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:36,412 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:36,413 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:36,413 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:36,413 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:36,413 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:36,416 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:36,418 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1339005569_0037_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:36,420 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:36,420 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1339005569_0037_m_000000_0' done.
2015-02-10 20:59:36,420 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1339005569_0037_m_000000_0
2015-02-10 20:59:36,421 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:36,421 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:36,421 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1339005569_0037_r_000000_0
2015-02-10 20:59:36,423 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:36,423 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@20197522
2015-02-10 20:59:36,424 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552979648, maxSingleShuffleLimit=138244912, mergeThreshold=364966592, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:36,425 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1339005569_0037_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:36,426 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#37 about to shuffle output of map attempt_local1339005569_0037_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:36,427 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1339005569_0037_m_000000_0
2015-02-10 20:59:36,427 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:36,428 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:36,429 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:36,429 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:36,431 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:36,431 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:36,433 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:36,433 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:36,434 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:36,434 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:36,434 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:36,435 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:36,436 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:36,436 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:36,440 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:36,441 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_REPLACE"]
2015-02-10 20:59:36,452 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1339005569_0037_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:36,453 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:36,454 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local1339005569_0037_r_000000_0 is allowed to commit now
2015-02-10 20:59:36,454 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1339005569_0037_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_REPLACE/_temporary/0/task_local1339005569_0037_r_000000
2015-02-10 20:59:36,456 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:36,456 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1339005569_0037_r_000000_0' done.
2015-02-10 20:59:36,456 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1339005569_0037_r_000000_0
2015-02-10 20:59:36,457 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:36,477 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_REPLACE/_temporary
2015-02-10 20:59:36,506 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:36,537 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:36,538 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_ARGS_REPLACE
2015-02-10 20:59:36,554 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:36,554 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:36,559 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:36,560 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:36,561 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:36,564 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:36,564 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:36,565 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_SWAP"]
2015-02-10 20:59:36,565 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:36,565 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:36,565 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:36,566 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...emblyplatform/0_ARGS_SWAP
2015-02-10 20:59:36,566 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:36,568 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:36,591 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:36,683 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:36,698 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1760156238_0038
2015-02-10 20:59:36,714 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1760156238/.staging/job_local1760156238_0038/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:36,715 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1760156238/.staging/job_local1760156238_0038/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:36,968 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1760156238_0038/job_local1760156238_0038.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:36,968 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1760156238_0038/job_local1760156238_0038.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:36,969 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:36,969 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1760156238_0038
2015-02-10 20:59:36,970 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:36,970 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:36,971 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:36,973 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:36,974 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1760156238_0038_m_000000_0
2015-02-10 20:59:36,975 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:36,976 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:36,976 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@231aaee1
2015-02-10 20:59:36,977 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:36,978 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:37,006 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:37,006 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:37,006 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:37,006 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:37,007 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:37,008 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:37,008 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:37,013 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:37,013 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:37,016 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:37,016 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:37,016 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:37,016 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:37,016 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:37,019 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:37,021 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1760156238_0038_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:37,022 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:37,023 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1760156238_0038_m_000000_0' done.
2015-02-10 20:59:37,023 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1760156238_0038_m_000000_0
2015-02-10 20:59:37,023 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:37,023 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:37,024 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1760156238_0038_r_000000_0
2015-02-10 20:59:37,025 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:37,025 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@7f2bad63
2015-02-10 20:59:37,026 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=553117248, maxSingleShuffleLimit=138279312, mergeThreshold=365057408, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:37,027 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1760156238_0038_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:37,028 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#38 about to shuffle output of map attempt_local1760156238_0038_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:37,029 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1760156238_0038_m_000000_0
2015-02-10 20:59:37,029 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:37,030 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:37,030 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:37,030 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:37,033 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:37,033 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:37,035 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:37,035 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:37,035 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:37,035 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:37,036 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:37,036 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:37,037 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:37,037 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:37,041 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:37,042 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_SWAP"]
2015-02-10 20:59:37,053 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1760156238_0038_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:37,054 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:37,054 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local1760156238_0038_r_000000_0 is allowed to commit now
2015-02-10 20:59:37,055 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1760156238_0038_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_SWAP/_temporary/0/task_local1760156238_0038_r_000000
2015-02-10 20:59:37,056 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:37,056 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1760156238_0038_r_000000_0' done.
2015-02-10 20:59:37,056 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1760156238_0038_r_000000_0
2015-02-10 20:59:37,057 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:37,071 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_SWAP/_temporary
2015-02-10 20:59:37,100 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:37,131 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:37,132 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_ARGS_SWAP
2015-02-10 20:59:37,150 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:37,150 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:37,155 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:37,157 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:37,157 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:37,161 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:37,161 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:37,161 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_-1"]
2015-02-10 20:59:37,161 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:37,162 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:37,162 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:37,162 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...lyplatform/ALL_'field'_-1
2015-02-10 20:59:37,163 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:37,164 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:37,187 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:37,205 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:37,219 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local108528858_0039
2015-02-10 20:59:37,235 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity108528858/.staging/job_local108528858_0039/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:37,236 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity108528858/.staging/job_local108528858_0039/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:37,280 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local108528858_0039/job_local108528858_0039.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:37,280 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local108528858_0039/job_local108528858_0039.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:37,281 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:37,281 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local108528858_0039
2015-02-10 20:59:37,281 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:37,281 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:37,282 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:37,285 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:37,285 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local108528858_0039_m_000000_0
2015-02-10 20:59:37,287 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:37,289 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:37,289 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@486ab98
2015-02-10 20:59:37,290 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:37,291 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:37,320 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:37,321 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:37,321 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:37,321 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:37,321 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:37,323 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:37,323 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:37,328 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:37,329 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:37,332 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:37,332 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:37,332 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:37,332 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:37,332 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:37,335 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:37,337 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local108528858_0039_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:37,338 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:37,339 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local108528858_0039_m_000000_0' done.
2015-02-10 20:59:37,339 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local108528858_0039_m_000000_0
2015-02-10 20:59:37,339 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:37,339 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:37,340 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local108528858_0039_r_000000_0
2015-02-10 20:59:37,342 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:37,342 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@53354a57
2015-02-10 20:59:37,343 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=553209024, maxSingleShuffleLimit=138302256, mergeThreshold=365117984, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:37,343 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local108528858_0039_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:37,345 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#39 about to shuffle output of map attempt_local108528858_0039_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:37,345 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local108528858_0039_m_000000_0
2015-02-10 20:59:37,346 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:37,346 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:37,348 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:37,348 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:37,353 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:37,353 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:37,355 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:37,355 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:37,355 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:37,356 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:37,356 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:37,356 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:37,357 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:37,357 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:37,361 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:37,362 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_-1"]
2015-02-10 20:59:37,373 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local108528858_0039_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:37,374 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:37,374 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local108528858_0039_r_000000_0 is allowed to commit now
2015-02-10 20:59:37,375 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local108528858_0039_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_-1/_temporary/0/task_local108528858_0039_r_000000
2015-02-10 20:59:37,376 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:37,376 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local108528858_0039_r_000000_0' done.
2015-02-10 20:59:37,376 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local108528858_0039_r_000000_0
2015-02-10 20:59:37,376 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:37,396 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_-1/_temporary
2015-02-10 20:59:37,424 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:37,453 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:37,455 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_-1
2015-02-10 20:59:37,471 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:37,472 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:37,477 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:37,478 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:37,479 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:37,482 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:37,483 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:37,483 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_'field'"]
2015-02-10 20:59:37,483 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:37,483 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:37,483 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:37,484 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...tform/ALL_'field'_'field'
2015-02-10 20:59:37,484 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:37,485 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:37,508 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:37,526 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:37,541 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1869523739_0040
2015-02-10 20:59:37,559 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1869523739/.staging/job_local1869523739_0040/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:37,559 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1869523739/.staging/job_local1869523739_0040/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:37,606 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1869523739_0040/job_local1869523739_0040.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:37,607 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1869523739_0040/job_local1869523739_0040.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:37,608 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:37,608 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1869523739_0040
2015-02-10 20:59:37,609 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:37,609 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:37,610 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:37,613 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:37,613 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1869523739_0040_m_000000_0
2015-02-10 20:59:37,614 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:37,616 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:37,616 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@4b935405
2015-02-10 20:59:37,617 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:37,617 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:37,646 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:37,646 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:37,646 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:37,646 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:37,646 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:37,648 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:37,648 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:37,652 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:37,652 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:37,655 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:37,655 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:37,655 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:37,656 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:37,656 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:37,658 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:37,660 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1869523739_0040_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:37,662 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:37,662 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1869523739_0040_m_000000_0' done.
2015-02-10 20:59:37,662 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1869523739_0040_m_000000_0
2015-02-10 20:59:37,662 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:37,663 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:37,663 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1869523739_0040_r_000000_0
2015-02-10 20:59:37,664 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:37,665 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@681564f4
2015-02-10 20:59:37,665 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=553300800, maxSingleShuffleLimit=138325200, mergeThreshold=365178528, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:37,666 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1869523739_0040_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:37,668 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#40 about to shuffle output of map attempt_local1869523739_0040_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:37,668 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1869523739_0040_m_000000_0
2015-02-10 20:59:37,668 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:37,669 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:37,669 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:37,670 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:37,671 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:37,671 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:37,673 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:37,673 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:37,673 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:37,674 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:37,674 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:37,674 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:37,675 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:37,675 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:37,679 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:37,679 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_'field'"]
2015-02-10 20:59:37,690 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1869523739_0040_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:37,692 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:37,692 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local1869523739_0040_r_000000_0 is allowed to commit now
2015-02-10 20:59:37,692 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1869523739_0040_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_'field'/_temporary/0/task_local1869523739_0040_r_000000
2015-02-10 20:59:37,693 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:37,694 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1869523739_0040_r_000000_0' done.
2015-02-10 20:59:37,694 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1869523739_0040_r_000000_0
2015-02-10 20:59:37,694 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:37,711 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_'field'/_temporary
2015-02-10 20:59:37,740 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:37,769 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:37,770 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_'field'
2015-02-10 20:59:37,786 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:37,786 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:37,791 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:37,793 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:37,793 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:37,796 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:37,796 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:37,796 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_RESULTS"]
2015-02-10 20:59:37,797 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:37,797 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:37,797 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:37,798 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...tform/ALL_'field'_RESULTS
2015-02-10 20:59:37,798 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:37,799 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:37,823 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:37,841 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:37,856 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local746255553_0041
2015-02-10 20:59:37,873 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity746255553/.staging/job_local746255553_0041/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:37,873 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity746255553/.staging/job_local746255553_0041/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:37,920 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local746255553_0041/job_local746255553_0041.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:37,920 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local746255553_0041/job_local746255553_0041.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:37,923 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:37,923 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local746255553_0041
2015-02-10 20:59:37,923 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:37,923 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:37,923 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:37,925 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:37,925 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local746255553_0041_m_000000_0
2015-02-10 20:59:37,927 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:37,928 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:37,928 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@f7fb9e0
2015-02-10 20:59:37,929 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:37,929 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:37,957 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:37,957 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:37,957 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:37,958 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:37,958 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:37,959 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:37,959 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:37,964 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:37,964 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:37,967 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:37,967 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:37,967 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:37,967 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:37,967 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:37,970 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:37,972 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local746255553_0041_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:37,974 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:37,974 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local746255553_0041_m_000000_0' done.
2015-02-10 20:59:37,974 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local746255553_0041_m_000000_0
2015-02-10 20:59:37,974 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:37,975 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:37,975 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local746255553_0041_r_000000_0
2015-02-10 20:59:37,976 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:37,976 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@7047da9b
2015-02-10 20:59:37,977 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=553300800, maxSingleShuffleLimit=138325200, mergeThreshold=365178528, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:37,978 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local746255553_0041_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:37,979 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#41 about to shuffle output of map attempt_local746255553_0041_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:37,979 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local746255553_0041_m_000000_0
2015-02-10 20:59:37,979 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:37,980 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:37,980 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:37,980 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:37,982 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:37,982 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:37,983 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:37,984 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:37,984 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:37,984 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:37,984 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:37,985 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:37,985 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:37,985 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:37,989 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:37,990 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_RESULTS"]
2015-02-10 20:59:38,001 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local746255553_0041_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:38,002 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:38,002 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local746255553_0041_r_000000_0 is allowed to commit now
2015-02-10 20:59:38,003 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local746255553_0041_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_RESULTS/_temporary/0/task_local746255553_0041_r_000000
2015-02-10 20:59:38,004 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:38,004 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local746255553_0041_r_000000_0' done.
2015-02-10 20:59:38,004 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local746255553_0041_r_000000_0
2015-02-10 20:59:38,004 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:38,022 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_RESULTS/_temporary
2015-02-10 20:59:38,050 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:38,079 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:38,081 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_RESULTS
2015-02-10 20:59:38,097 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:38,097 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:38,103 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:38,105 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:38,105 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:38,108 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:38,109 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:38,109 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_ALL"]
2015-02-10 20:59:38,109 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:38,110 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:38,110 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:38,111 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...yplatform/ALL_'field'_ALL
2015-02-10 20:59:38,111 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:38,112 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:38,135 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:38,153 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:38,168 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local835480914_0042
2015-02-10 20:59:38,186 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity835480914/.staging/job_local835480914_0042/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:38,186 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity835480914/.staging/job_local835480914_0042/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:38,232 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local835480914_0042/job_local835480914_0042.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:38,233 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local835480914_0042/job_local835480914_0042.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:38,234 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:38,234 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:38,235 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:38,234 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local835480914_0042
2015-02-10 20:59:38,235 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:38,236 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:38,237 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local835480914_0042_m_000000_0
2015-02-10 20:59:38,238 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:38,239 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:38,240 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@5db533b0
2015-02-10 20:59:38,241 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:38,241 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:38,271 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:38,271 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:38,271 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:38,271 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:38,271 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:38,273 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:38,273 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:38,278 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:38,278 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:38,281 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:38,282 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:38,282 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:38,282 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:38,282 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:38,286 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:38,287 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local835480914_0042_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:38,289 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:38,290 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local835480914_0042_m_000000_0' done.
2015-02-10 20:59:38,290 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local835480914_0042_m_000000_0
2015-02-10 20:59:38,290 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:38,291 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:38,291 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local835480914_0042_r_000000_0
2015-02-10 20:59:38,293 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:38,293 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@4e345c87
2015-02-10 20:59:38,294 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=553392512, maxSingleShuffleLimit=138348128, mergeThreshold=365239072, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:38,295 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local835480914_0042_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:38,296 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#42 about to shuffle output of map attempt_local835480914_0042_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:38,296 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local835480914_0042_m_000000_0
2015-02-10 20:59:38,296 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:38,297 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:38,298 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:38,298 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:38,300 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:38,300 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:38,302 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:38,302 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:38,302 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:38,303 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:38,303 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:38,304 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:38,305 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:38,305 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:38,309 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:38,310 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_ALL"]
2015-02-10 20:59:38,322 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local835480914_0042_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:38,323 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:38,324 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local835480914_0042_r_000000_0 is allowed to commit now
2015-02-10 20:59:38,324 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local835480914_0042_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_ALL/_temporary/0/task_local835480914_0042_r_000000
2015-02-10 20:59:38,326 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:38,326 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local835480914_0042_r_000000_0' done.
2015-02-10 20:59:38,326 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local835480914_0042_r_000000_0
2015-02-10 20:59:38,327 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:38,346 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_ALL/_temporary
2015-02-10 20:59:38,374 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:38,404 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:38,405 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_ALL
2015-02-10 20:59:38,420 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:38,421 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:38,424 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_REPLACE
2015-02-10 20:59:38,439 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:38,440 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:38,444 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:38,446 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:38,446 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:38,449 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:38,450 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:38,450 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_SWAP"]
2015-02-10 20:59:38,450 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:38,450 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:38,450 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:38,452 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...platform/ALL_'field'_SWAP
2015-02-10 20:59:38,452 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:38,453 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:38,476 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:38,494 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:38,509 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local601118365_0043
2015-02-10 20:59:38,526 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity601118365/.staging/job_local601118365_0043/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:38,526 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity601118365/.staging/job_local601118365_0043/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:38,572 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local601118365_0043/job_local601118365_0043.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:38,572 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local601118365_0043/job_local601118365_0043.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:38,573 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:38,574 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local601118365_0043
2015-02-10 20:59:38,574 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:38,574 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:38,574 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:38,576 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:38,577 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local601118365_0043_m_000000_0
2015-02-10 20:59:38,578 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:38,579 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:38,580 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@49a8422e
2015-02-10 20:59:38,581 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:38,581 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:38,610 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:38,610 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:38,610 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:38,610 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:38,610 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:38,612 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:38,612 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:38,616 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:38,616 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:38,619 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:38,620 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:38,620 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:38,620 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:38,620 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:38,623 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:38,624 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local601118365_0043_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:38,626 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:38,626 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local601118365_0043_m_000000_0' done.
2015-02-10 20:59:38,627 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local601118365_0043_m_000000_0
2015-02-10 20:59:38,627 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:38,627 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:38,627 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local601118365_0043_r_000000_0
2015-02-10 20:59:38,629 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:38,629 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@49cf882
2015-02-10 20:59:38,630 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=553392512, maxSingleShuffleLimit=138348128, mergeThreshold=365239072, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:38,630 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local601118365_0043_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:38,631 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#43 about to shuffle output of map attempt_local601118365_0043_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:38,632 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local601118365_0043_m_000000_0
2015-02-10 20:59:38,632 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:38,632 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:38,633 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:38,633 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:38,635 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:38,635 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:38,636 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:38,637 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:38,637 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:38,637 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:38,637 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:38,638 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:38,638 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:38,638 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:38,642 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:38,642 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_SWAP"]
2015-02-10 20:59:38,654 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local601118365_0043_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:38,655 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:38,655 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local601118365_0043_r_000000_0 is allowed to commit now
2015-02-10 20:59:38,656 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local601118365_0043_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_SWAP/_temporary/0/task_local601118365_0043_r_000000
2015-02-10 20:59:38,657 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:38,657 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local601118365_0043_r_000000_0' done.
2015-02-10 20:59:38,657 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local601118365_0043_r_000000_0
2015-02-10 20:59:38,658 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:38,675 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_SWAP/_temporary
2015-02-10 20:59:38,704 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:38,737 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:38,738 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_SWAP
2015-02-10 20:59:38,753 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:38,754 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:38,758 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:38,760 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:38,760 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:38,763 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:38,764 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:38,764 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_-1"]
2015-02-10 20:59:38,764 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:38,764 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:38,764 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:38,765 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...lyplatform/ALL_UNKNOWN_-1
2015-02-10 20:59:38,765 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:38,766 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:38,789 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:38,807 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:38,821 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local814239493_0044
2015-02-10 20:59:38,838 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity814239493/.staging/job_local814239493_0044/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:38,838 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity814239493/.staging/job_local814239493_0044/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:38,884 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local814239493_0044/job_local814239493_0044.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:38,884 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local814239493_0044/job_local814239493_0044.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:38,886 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:38,886 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:38,886 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local814239493_0044
2015-02-10 20:59:38,887 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:38,887 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:38,889 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:38,889 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local814239493_0044_m_000000_0
2015-02-10 20:59:38,890 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:38,891 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:38,892 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@12da876
2015-02-10 20:59:38,893 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:38,893 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:38,922 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:38,922 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:38,922 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:38,922 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:38,922 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:38,923 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:38,924 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:38,927 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:38,927 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:38,930 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:38,930 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:38,931 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:38,931 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:38,931 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:38,933 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:38,935 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local814239493_0044_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:38,937 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:38,937 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local814239493_0044_m_000000_0' done.
2015-02-10 20:59:38,937 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local814239493_0044_m_000000_0
2015-02-10 20:59:38,937 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:38,938 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:38,938 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local814239493_0044_r_000000_0
2015-02-10 20:59:38,939 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:38,939 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@4dfbbcea
2015-02-10 20:59:38,940 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=553484288, maxSingleShuffleLimit=138371072, mergeThreshold=365299648, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:38,941 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local814239493_0044_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:38,942 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#44 about to shuffle output of map attempt_local814239493_0044_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:38,942 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local814239493_0044_m_000000_0
2015-02-10 20:59:38,942 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:38,943 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:38,944 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:38,944 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:38,945 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:38,945 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:38,947 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:38,947 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:38,947 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:38,947 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:38,948 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:38,948 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:38,948 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:38,949 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:38,952 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:38,952 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_-1"]
2015-02-10 20:59:38,964 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local814239493_0044_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:38,965 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:38,965 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local814239493_0044_r_000000_0 is allowed to commit now
2015-02-10 20:59:38,965 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local814239493_0044_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_-1/_temporary/0/task_local814239493_0044_r_000000
2015-02-10 20:59:38,967 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:38,967 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local814239493_0044_r_000000_0' done.
2015-02-10 20:59:38,967 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local814239493_0044_r_000000_0
2015-02-10 20:59:38,967 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:38,986 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_-1/_temporary
2015-02-10 20:59:39,015 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:39,045 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:39,046 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_-1
2015-02-10 20:59:39,061 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:39,062 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:39,065 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_'field'
2015-02-10 20:59:39,081 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:39,081 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:39,085 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:39,087 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:39,087 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:39,090 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:39,091 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:39,091 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_RESULTS"]
2015-02-10 20:59:39,091 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:39,091 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:39,091 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:39,092 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...tform/ALL_UNKNOWN_RESULTS
2015-02-10 20:59:39,092 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:39,093 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:39,116 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:39,135 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:39,149 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1659261201_0045
2015-02-10 20:59:39,166 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1659261201/.staging/job_local1659261201_0045/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:39,166 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1659261201/.staging/job_local1659261201_0045/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:39,210 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1659261201_0045/job_local1659261201_0045.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:39,211 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1659261201_0045/job_local1659261201_0045.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:39,212 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:39,212 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:39,213 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:39,212 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1659261201_0045
2015-02-10 20:59:39,213 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:39,215 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:39,215 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1659261201_0045_m_000000_0
2015-02-10 20:59:39,216 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:39,217 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:39,217 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@216b58fa
2015-02-10 20:59:39,218 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:39,219 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:39,247 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:39,247 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:39,247 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:39,247 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:39,247 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:39,248 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:39,248 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:39,252 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:39,252 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:39,255 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:39,255 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:39,255 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:39,255 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:39,255 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:39,258 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:39,260 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1659261201_0045_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:39,261 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:39,261 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1659261201_0045_m_000000_0' done.
2015-02-10 20:59:39,262 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1659261201_0045_m_000000_0
2015-02-10 20:59:39,262 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:39,262 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:39,262 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1659261201_0045_r_000000_0
2015-02-10 20:59:39,264 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:39,264 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@7006cfce
2015-02-10 20:59:39,265 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=553484288, maxSingleShuffleLimit=138371072, mergeThreshold=365299648, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:39,266 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1659261201_0045_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:39,267 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#45 about to shuffle output of map attempt_local1659261201_0045_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:39,267 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1659261201_0045_m_000000_0
2015-02-10 20:59:39,267 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:39,268 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:39,268 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:39,269 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:39,270 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:39,270 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:39,271 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:39,272 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:39,272 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:39,272 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:39,272 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:39,273 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:39,273 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:39,273 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:39,276 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:39,277 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_RESULTS"]
2015-02-10 20:59:39,288 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1659261201_0045_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:39,289 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:39,289 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local1659261201_0045_r_000000_0 is allowed to commit now
2015-02-10 20:59:39,290 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1659261201_0045_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_RESULTS/_temporary/0/task_local1659261201_0045_r_000000
2015-02-10 20:59:39,291 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:39,291 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1659261201_0045_r_000000_0' done.
2015-02-10 20:59:39,291 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1659261201_0045_r_000000_0
2015-02-10 20:59:39,292 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:39,311 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_RESULTS/_temporary
2015-02-10 20:59:39,340 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:39,368 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:39,369 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_RESULTS
2015-02-10 20:59:39,385 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:39,385 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:39,389 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:39,391 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:39,391 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:39,394 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:39,395 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:39,395 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_ALL"]
2015-02-10 20:59:39,395 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:39,395 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:39,395 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:39,396 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...yplatform/ALL_UNKNOWN_ALL
2015-02-10 20:59:39,396 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:39,397 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:39,420 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:39,437 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:39,451 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1570275348_0046
2015-02-10 20:59:39,467 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1570275348/.staging/job_local1570275348_0046/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:39,468 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1570275348/.staging/job_local1570275348_0046/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:39,511 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1570275348_0046/job_local1570275348_0046.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:39,511 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1570275348_0046/job_local1570275348_0046.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:39,512 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:39,512 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:39,512 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1570275348_0046
2015-02-10 20:59:39,513 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:39,513 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:39,515 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:39,515 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1570275348_0046_m_000000_0
2015-02-10 20:59:39,516 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:39,518 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:39,518 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@7ff7c46e
2015-02-10 20:59:39,519 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:39,519 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:39,549 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:39,550 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:39,550 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:39,550 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:39,551 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:39,552 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:39,552 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:39,556 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:39,556 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:39,559 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:39,559 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:39,559 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:39,559 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:39,560 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:39,562 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:39,564 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1570275348_0046_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:39,565 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:39,566 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1570275348_0046_m_000000_0' done.
2015-02-10 20:59:39,566 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1570275348_0046_m_000000_0
2015-02-10 20:59:39,566 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:39,566 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:39,567 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1570275348_0046_r_000000_0
2015-02-10 20:59:39,568 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:39,568 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@6c5a8d3b
2015-02-10 20:59:39,569 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=553576000, maxSingleShuffleLimit=138394000, mergeThreshold=365360160, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:39,570 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1570275348_0046_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:39,571 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#46 about to shuffle output of map attempt_local1570275348_0046_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:39,571 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1570275348_0046_m_000000_0
2015-02-10 20:59:39,571 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:39,572 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:39,573 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:39,573 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:39,576 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:39,576 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:39,577 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:39,578 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:39,578 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:39,578 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:39,578 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:39,579 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:39,579 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:39,579 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:39,583 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:39,583 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_ALL"]
2015-02-10 20:59:39,595 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1570275348_0046_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:39,596 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:39,596 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local1570275348_0046_r_000000_0 is allowed to commit now
2015-02-10 20:59:39,597 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1570275348_0046_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_ALL/_temporary/0/task_local1570275348_0046_r_000000
2015-02-10 20:59:39,598 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:39,599 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1570275348_0046_r_000000_0' done.
2015-02-10 20:59:39,599 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1570275348_0046_r_000000_0
2015-02-10 20:59:39,599 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:39,614 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_ALL/_temporary
2015-02-10 20:59:39,642 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:39,672 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:39,673 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_ALL
2015-02-10 20:59:39,690 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:39,690 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:39,695 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:39,696 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:39,697 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:39,700 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:39,700 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:39,701 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_REPLACE"]
2015-02-10 20:59:39,701 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:39,701 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:39,702 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:39,702 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...tform/ALL_UNKNOWN_REPLACE
2015-02-10 20:59:39,703 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:39,704 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:39,727 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:39,745 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:39,760 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1573602999_0047
2015-02-10 20:59:39,776 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1573602999/.staging/job_local1573602999_0047/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:39,776 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1573602999/.staging/job_local1573602999_0047/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:39,821 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:39,825 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1573602999_0047/job_local1573602999_0047.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:39,825 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1573602999_0047/job_local1573602999_0047.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:39,826 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:39,826 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1573602999_0047
2015-02-10 20:59:39,826 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:39,827 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:39,826 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:39,829 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:39,829 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1573602999_0047_m_000000_0
2015-02-10 20:59:39,831 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:39,833 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:39,833 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@55a2e547
2015-02-10 20:59:39,835 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:39,835 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:39,864 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:39,865 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:39,865 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:39,865 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:39,866 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:39,868 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:39,869 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:39,873 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:39,873 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:39,876 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:39,877 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:39,877 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:39,877 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:39,877 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:39,880 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:39,882 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1573602999_0047_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:39,884 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:39,884 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1573602999_0047_m_000000_0' done.
2015-02-10 20:59:39,885 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1573602999_0047_m_000000_0
2015-02-10 20:59:39,885 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:39,885 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:39,886 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1573602999_0047_r_000000_0
2015-02-10 20:59:39,887 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:39,888 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@c2ccccf
2015-02-10 20:59:39,889 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=553576000, maxSingleShuffleLimit=138394000, mergeThreshold=365360160, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:39,890 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1573602999_0047_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:39,891 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#47 about to shuffle output of map attempt_local1573602999_0047_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:39,891 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1573602999_0047_m_000000_0
2015-02-10 20:59:39,892 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:39,892 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:39,893 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:39,893 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:39,897 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:39,897 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:39,900 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:39,900 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:39,901 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:39,901 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:39,901 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:39,902 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:39,902 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:39,903 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:39,906 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:39,906 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_REPLACE"]
2015-02-10 20:59:39,914 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:39,915 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:39,916 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1573602999_0047
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:39,918 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local1573602999_0047 state at FAILED
2015-02-10 20:59:39,918 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 20:59:39,918 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 20:59:39,918 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 20:59:39,926 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 20:59:39,926 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...tform/ALL_UNKNOWN_REPLACE
2015-02-10 20:59:39,927 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 20:59:39,927 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_REPLACE/_temporary
2015-02-10 20:59:39,927 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_REPLACE
2015-02-10 20:59:39,943 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:39,943 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:39,947 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:39,949 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:39,950 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:39,952 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:39,953 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:39,953 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_SWAP"]
2015-02-10 20:59:39,953 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:39,953 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:39,953 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:39,954 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...platform/ALL_UNKNOWN_SWAP
2015-02-10 20:59:39,954 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:39,955 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:39,978 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:39,995 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:40,010 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1383678862_0048
2015-02-10 20:59:40,026 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1383678862/.staging/job_local1383678862_0048/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:40,027 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1383678862/.staging/job_local1383678862_0048/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:40,071 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1383678862_0048/job_local1383678862_0048.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:40,071 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1383678862_0048/job_local1383678862_0048.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:40,073 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:40,073 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:40,073 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:40,073 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1383678862_0048
2015-02-10 20:59:40,074 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:40,075 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:40,075 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1383678862_0048_m_000000_0
2015-02-10 20:59:40,076 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:40,078 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:40,078 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@54b216b3
2015-02-10 20:59:40,079 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:40,079 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:40,096 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:40,097 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:40,097 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:40,097 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:40,097 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:40,098 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:40,098 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:40,101 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:40,102 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:40,104 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:40,104 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:40,104 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:40,105 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:40,105 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:40,107 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:40,109 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1383678862_0048_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:40,110 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:40,110 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1383678862_0048_m_000000_0' done.
2015-02-10 20:59:40,121 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1383678862_0048_m_000000_0
2015-02-10 20:59:40,122 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:40,123 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:40,123 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1383678862_0048_r_000000_0
2015-02-10 20:59:40,125 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:40,125 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@37b2cb94
2015-02-10 20:59:40,126 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=553667776, maxSingleShuffleLimit=138416944, mergeThreshold=365420736, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:40,127 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1383678862_0048_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:40,129 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#48 about to shuffle output of map attempt_local1383678862_0048_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:40,129 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1383678862_0048_m_000000_0
2015-02-10 20:59:40,130 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:40,130 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:40,131 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:40,131 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:40,133 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:40,133 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:40,135 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:40,135 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:40,135 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:40,135 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:40,136 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:40,136 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:40,137 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:40,137 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:40,140 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:40,141 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_SWAP"]
2015-02-10 20:59:40,152 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1383678862_0048_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:40,153 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:40,153 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local1383678862_0048_r_000000_0 is allowed to commit now
2015-02-10 20:59:40,154 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1383678862_0048_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_SWAP/_temporary/0/task_local1383678862_0048_r_000000
2015-02-10 20:59:40,155 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:40,155 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1383678862_0048_r_000000_0' done.
2015-02-10 20:59:40,155 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1383678862_0048_r_000000_0
2015-02-10 20:59:40,155 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:40,176 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_SWAP/_temporary
2015-02-10 20:59:40,205 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:40,234 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:40,235 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_SWAP
2015-02-10 20:59:40,250 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:40,251 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:40,255 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:40,257 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:40,257 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:40,260 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:40,260 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:40,261 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_-1"]
2015-02-10 20:59:40,261 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:40,261 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:40,261 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:40,262 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...blyplatform/ALL_VALUES_-1
2015-02-10 20:59:40,263 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:40,263 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:40,288 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:40,307 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:40,322 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local660223014_0049
2015-02-10 20:59:40,339 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity660223014/.staging/job_local660223014_0049/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:40,340 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity660223014/.staging/job_local660223014_0049/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:40,386 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local660223014_0049/job_local660223014_0049.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:40,387 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local660223014_0049/job_local660223014_0049.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:40,388 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:40,389 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local660223014_0049
2015-02-10 20:59:40,389 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:40,389 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:40,390 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:40,392 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:40,392 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local660223014_0049_m_000000_0
2015-02-10 20:59:40,393 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:40,395 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:40,395 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@69e1968d
2015-02-10 20:59:40,396 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:40,396 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:40,413 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:40,415 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:40,415 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:40,415 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:40,416 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:40,415 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:40,418 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:40,419 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:40,422 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:40,422 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:40,425 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:40,425 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:40,425 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:40,425 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:40,425 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:40,428 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:40,429 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local660223014_0049_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:40,431 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:40,431 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local660223014_0049_m_000000_0' done.
2015-02-10 20:59:40,431 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local660223014_0049_m_000000_0
2015-02-10 20:59:40,431 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:40,432 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:40,432 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local660223014_0049_r_000000_0
2015-02-10 20:59:40,433 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:40,433 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@4e6358de
2015-02-10 20:59:40,434 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=553667776, maxSingleShuffleLimit=138416944, mergeThreshold=365420736, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:40,435 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local660223014_0049_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:40,436 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#49 about to shuffle output of map attempt_local660223014_0049_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:40,436 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local660223014_0049_m_000000_0
2015-02-10 20:59:40,436 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:40,437 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:40,437 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:40,438 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:40,439 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:40,439 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:40,440 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:40,441 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:40,441 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:40,441 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:40,441 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:40,442 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:40,442 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:40,442 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:40,445 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:40,446 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_-1"]
2015-02-10 20:59:40,453 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:40,454 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:40,456 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local660223014_0049
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:40,456 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local660223014_0049 state at FAILED
2015-02-10 20:59:40,456 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 20:59:40,456 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 20:59:40,457 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 20:59:40,460 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 20:59:40,460 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...blyplatform/ALL_VALUES_-1
2015-02-10 20:59:40,463 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 20:59:40,463 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_-1/_temporary
2015-02-10 20:59:40,464 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_-1
2015-02-10 20:59:40,479 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:40,479 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:40,483 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_'field'
2015-02-10 20:59:40,502 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:40,502 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:40,507 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:40,509 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:40,509 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:40,513 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:40,513 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:40,513 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_RESULTS"]
2015-02-10 20:59:40,514 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:40,514 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:40,514 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:40,515 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...atform/ALL_VALUES_RESULTS
2015-02-10 20:59:40,516 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:40,517 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:40,541 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:40,559 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:40,575 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1822655680_0050
2015-02-10 20:59:40,593 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1822655680/.staging/job_local1822655680_0050/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:40,594 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1822655680/.staging/job_local1822655680_0050/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:40,643 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1822655680_0050/job_local1822655680_0050.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:40,644 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1822655680_0050/job_local1822655680_0050.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:40,645 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:40,646 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:40,646 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:40,646 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1822655680_0050
2015-02-10 20:59:40,646 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:40,649 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:40,649 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1822655680_0050_m_000000_0
2015-02-10 20:59:40,650 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:40,651 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:40,652 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@2e24d74d
2015-02-10 20:59:40,653 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:40,653 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:40,681 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:40,682 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:40,682 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:40,682 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:40,682 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:40,683 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:40,683 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:40,684 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:40,687 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:40,687 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:40,689 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:40,690 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:40,690 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:40,690 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:40,690 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:40,692 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:40,694 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1822655680_0050_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:40,696 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:40,696 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1822655680_0050_m_000000_0' done.
2015-02-10 20:59:40,696 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1822655680_0050_m_000000_0
2015-02-10 20:59:40,696 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:40,697 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:40,697 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1822655680_0050_r_000000_0
2015-02-10 20:59:40,698 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:40,698 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@37fd3fc
2015-02-10 20:59:40,699 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=553759552, maxSingleShuffleLimit=138439888, mergeThreshold=365481312, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:40,699 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1822655680_0050_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:40,701 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#50 about to shuffle output of map attempt_local1822655680_0050_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:40,701 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1822655680_0050_m_000000_0
2015-02-10 20:59:40,701 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:40,702 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:40,702 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:40,702 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:40,704 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:40,704 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:40,705 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:40,706 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:40,706 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:40,706 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:40,706 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:40,707 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:40,707 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:40,707 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:40,710 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:40,710 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_RESULTS"]
2015-02-10 20:59:40,718 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:40,719 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:40,722 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1822655680_0050
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:40,722 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local1822655680_0050 state at FAILED
2015-02-10 20:59:40,723 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 20:59:40,723 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 20:59:40,723 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 20:59:40,726 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 20:59:40,727 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...atform/ALL_VALUES_RESULTS
2015-02-10 20:59:40,728 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 20:59:40,728 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_RESULTS/_temporary
2015-02-10 20:59:40,728 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_RESULTS
2015-02-10 20:59:40,744 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:40,744 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:40,749 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:40,750 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:40,751 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:40,754 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:40,754 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:40,755 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_ALL"]
2015-02-10 20:59:40,755 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:40,755 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:40,755 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:40,756 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...lyplatform/ALL_VALUES_ALL
2015-02-10 20:59:40,757 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:40,758 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:40,782 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:40,800 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:40,816 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local115798980_0051
2015-02-10 20:59:40,832 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity115798980/.staging/job_local115798980_0051/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:40,832 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity115798980/.staging/job_local115798980_0051/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:40,876 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local115798980_0051/job_local115798980_0051.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:40,877 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local115798980_0051/job_local115798980_0051.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:40,878 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:40,878 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:40,879 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:40,878 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local115798980_0051
2015-02-10 20:59:40,879 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:40,881 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:40,881 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local115798980_0051_m_000000_0
2015-02-10 20:59:40,882 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:40,883 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:40,883 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@741c42a9
2015-02-10 20:59:40,884 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:40,885 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:40,903 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:40,903 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:40,903 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:40,904 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:40,904 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:40,905 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:40,905 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:40,909 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:40,909 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:40,912 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:40,912 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:40,912 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:40,912 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:40,912 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:40,916 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:41,192 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:41,193 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local115798980_0051_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:41,195 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:41,195 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local115798980_0051_m_000000_0' done.
2015-02-10 20:59:41,195 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local115798980_0051_m_000000_0
2015-02-10 20:59:41,196 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:41,196 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:41,197 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local115798980_0051_r_000000_0
2015-02-10 20:59:41,198 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:41,198 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@239f768f
2015-02-10 20:59:41,199 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:41,199 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local115798980_0051_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:41,201 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#51 about to shuffle output of map attempt_local115798980_0051_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:41,202 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local115798980_0051_m_000000_0
2015-02-10 20:59:41,202 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:41,202 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:41,205 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:41,205 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:41,207 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:41,207 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:41,208 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:41,208 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:41,208 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:41,209 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:41,209 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:41,209 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:41,210 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:41,210 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:41,213 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:41,213 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_ALL"]
2015-02-10 20:59:41,221 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:41,221 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:41,223 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local115798980_0051
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:41,231 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local115798980_0051 state at FAILED
2015-02-10 20:59:41,231 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 20:59:41,232 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 20:59:41,232 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 20:59:41,235 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 20:59:41,235 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...lyplatform/ALL_VALUES_ALL
2015-02-10 20:59:41,236 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 20:59:41,236 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_ALL/_temporary
2015-02-10 20:59:41,237 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_ALL
2015-02-10 20:59:41,252 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:41,253 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:41,257 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:41,259 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:41,259 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:41,264 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:41,264 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:41,265 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_REPLACE"]
2015-02-10 20:59:41,265 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:41,266 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:41,266 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:41,267 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...atform/ALL_VALUES_REPLACE
2015-02-10 20:59:41,268 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:41,270 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:41,273 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:41,292 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:41,310 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:41,324 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1924989902_0052
2015-02-10 20:59:41,340 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1924989902/.staging/job_local1924989902_0052/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:41,340 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1924989902/.staging/job_local1924989902_0052/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:41,389 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1924989902_0052/job_local1924989902_0052.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:41,389 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1924989902_0052/job_local1924989902_0052.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:41,391 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:41,391 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:41,391 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1924989902_0052
2015-02-10 20:59:41,392 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:41,392 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:41,394 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:41,394 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1924989902_0052_m_000000_0
2015-02-10 20:59:41,396 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:41,397 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:41,397 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@284dbb2f
2015-02-10 20:59:41,399 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:41,399 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:41,417 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:41,417 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:41,417 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:41,417 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:41,418 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:41,420 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:41,420 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:41,424 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:41,424 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:41,427 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:41,427 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:41,427 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:41,427 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:41,427 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:41,430 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:41,431 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1924989902_0052_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:41,433 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:41,433 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1924989902_0052_m_000000_0' done.
2015-02-10 20:59:41,433 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1924989902_0052_m_000000_0
2015-02-10 20:59:41,433 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:41,434 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:41,434 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1924989902_0052_r_000000_0
2015-02-10 20:59:41,435 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:41,435 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@a7ab0f7
2015-02-10 20:59:41,436 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:41,437 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1924989902_0052_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:41,438 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#52 about to shuffle output of map attempt_local1924989902_0052_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:41,438 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1924989902_0052_m_000000_0
2015-02-10 20:59:41,438 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:41,439 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:41,439 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:41,440 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:41,443 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:41,443 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:41,445 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:41,445 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:41,445 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:41,445 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:41,446 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:41,446 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:41,447 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:41,447 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:41,450 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:41,450 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_REPLACE"]
2015-02-10 20:59:41,458 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:41,459 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:41,460 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1924989902_0052
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:41,464 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local1924989902_0052 state at FAILED
2015-02-10 20:59:41,464 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 20:59:41,464 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 20:59:41,464 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 20:59:41,467 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 20:59:41,468 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...atform/ALL_VALUES_REPLACE
2015-02-10 20:59:41,468 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 20:59:41,469 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_REPLACE/_temporary
2015-02-10 20:59:41,469 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_REPLACE
2015-02-10 20:59:41,484 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:41,485 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:41,489 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:41,491 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:41,491 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:41,494 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:41,494 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:41,495 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_SWAP"]
2015-02-10 20:59:41,495 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:41,495 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:41,495 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:41,496 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...yplatform/ALL_VALUES_SWAP
2015-02-10 20:59:41,496 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:41,497 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:41,512 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:41,520 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:41,537 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:41,551 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1716569034_0053
2015-02-10 20:59:41,567 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1716569034/.staging/job_local1716569034_0053/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:41,567 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1716569034/.staging/job_local1716569034_0053/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:41,610 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1716569034_0053/job_local1716569034_0053.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:41,611 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1716569034_0053/job_local1716569034_0053.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:41,612 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:41,612 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1716569034_0053
2015-02-10 20:59:41,612 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:41,612 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:41,613 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:41,642 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:41,643 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1716569034_0053_m_000000_0
2015-02-10 20:59:41,644 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:41,645 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:41,645 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@67c8f3da
2015-02-10 20:59:41,646 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:41,646 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:41,667 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:41,667 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:41,667 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:41,667 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:41,667 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:41,668 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:41,668 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:41,672 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:41,672 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:41,675 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:41,676 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:41,676 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:41,676 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:41,676 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:41,679 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:41,681 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1716569034_0053_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:41,682 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:41,683 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1716569034_0053_m_000000_0' done.
2015-02-10 20:59:41,683 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1716569034_0053_m_000000_0
2015-02-10 20:59:41,683 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:41,684 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:41,684 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1716569034_0053_r_000000_0
2015-02-10 20:59:41,685 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:41,686 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@7bb8597a
2015-02-10 20:59:41,686 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:41,687 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1716569034_0053_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:41,688 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#53 about to shuffle output of map attempt_local1716569034_0053_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:41,689 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1716569034_0053_m_000000_0
2015-02-10 20:59:41,689 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:41,689 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:41,690 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:41,690 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:41,692 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:41,692 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:41,694 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:41,694 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:41,694 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:41,695 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:41,695 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:41,696 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:41,696 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:41,696 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:41,699 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:41,700 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_SWAP"]
2015-02-10 20:59:41,707 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:41,710 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:41,712 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1716569034_0053
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:41,714 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local1716569034_0053 state at FAILED
2015-02-10 20:59:41,714 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 20:59:41,714 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 20:59:41,715 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 20:59:41,718 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 20:59:41,718 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...yplatform/ALL_VALUES_SWAP
2015-02-10 20:59:41,719 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 20:59:41,719 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_SWAP/_temporary
2015-02-10 20:59:41,720 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_SWAP
2015-02-10 20:59:41,735 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:41,735 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:41,740 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:41,741 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:41,742 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:41,745 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:41,745 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:41,745 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_-1"]
2015-02-10 20:59:41,745 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:41,745 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:41,745 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:41,746 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...emblyplatform/ALL_ARGS_-1
2015-02-10 20:59:41,746 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:41,748 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:41,771 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:41,789 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:41,803 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1982776983_0054
2015-02-10 20:59:41,819 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1982776983/.staging/job_local1982776983_0054/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:41,820 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1982776983/.staging/job_local1982776983_0054/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:41,865 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1982776983_0054/job_local1982776983_0054.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:41,865 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1982776983_0054/job_local1982776983_0054.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:41,866 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:41,866 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1982776983_0054
2015-02-10 20:59:41,866 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:41,867 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:41,867 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:41,869 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:41,869 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1982776983_0054_m_000000_0
2015-02-10 20:59:41,870 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:41,872 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:41,872 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@24a617aa
2015-02-10 20:59:41,873 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:41,873 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:41,891 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:41,891 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:41,891 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:41,892 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:41,892 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:41,893 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:41,893 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:41,897 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:41,897 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:41,900 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:41,900 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:41,901 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:41,901 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:41,901 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:41,904 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:41,905 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1982776983_0054_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:41,907 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:41,907 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1982776983_0054_m_000000_0' done.
2015-02-10 20:59:41,908 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1982776983_0054_m_000000_0
2015-02-10 20:59:41,908 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:41,908 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:41,909 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1982776983_0054_r_000000_0
2015-02-10 20:59:41,910 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:41,910 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@4f7b9ed4
2015-02-10 20:59:41,911 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:41,912 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1982776983_0054_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:41,913 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#54 about to shuffle output of map attempt_local1982776983_0054_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:41,914 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1982776983_0054_m_000000_0
2015-02-10 20:59:41,914 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:41,914 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:41,915 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:41,915 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:41,920 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:41,920 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:41,921 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:41,922 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:41,922 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:41,922 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:41,923 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:41,924 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:41,924 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:41,924 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:41,929 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:41,930 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_-1"]
2015-02-10 20:59:41,939 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:41,939 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:41,941 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1982776983_0054
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:41,949 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local1982776983_0054 state at FAILED
2015-02-10 20:59:41,949 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 20:59:41,949 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 20:59:41,949 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 20:59:41,952 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 20:59:41,953 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...emblyplatform/ALL_ARGS_-1
2015-02-10 20:59:41,953 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 20:59:41,954 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_-1/_temporary
2015-02-10 20:59:41,954 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_-1
2015-02-10 20:59:41,969 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:41,970 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:41,973 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_'field'
2015-02-10 20:59:41,988 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:41,988 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:41,993 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:41,994 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:41,995 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:41,997 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:41,998 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:41,998 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_RESULTS"]
2015-02-10 20:59:41,998 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:41,998 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:41,998 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:41,999 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...platform/ALL_ARGS_RESULTS
2015-02-10 20:59:41,999 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:42,000 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:42,022 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:42,040 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:42,055 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1866321725_0055
2015-02-10 20:59:42,072 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1866321725/.staging/job_local1866321725_0055/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:42,072 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1866321725/.staging/job_local1866321725_0055/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:42,116 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1866321725_0055/job_local1866321725_0055.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:42,116 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1866321725_0055/job_local1866321725_0055.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:42,117 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:42,117 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1866321725_0055
2015-02-10 20:59:42,117 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:42,117 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:42,118 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:42,120 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:42,120 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1866321725_0055_m_000000_0
2015-02-10 20:59:42,121 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:42,123 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:42,123 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@ed5ad5d
2015-02-10 20:59:42,124 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:42,124 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:42,143 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:42,143 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:42,143 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:42,143 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:42,143 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:42,144 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:42,145 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:42,148 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:42,148 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:42,151 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:42,151 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:42,151 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:42,152 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:42,152 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:42,155 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:42,156 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1866321725_0055_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:42,158 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:42,158 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1866321725_0055_m_000000_0' done.
2015-02-10 20:59:42,158 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1866321725_0055_m_000000_0
2015-02-10 20:59:42,158 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:42,159 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:42,160 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1866321725_0055_r_000000_0
2015-02-10 20:59:42,161 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:42,161 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@38e00a5e
2015-02-10 20:59:42,162 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:42,163 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1866321725_0055_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:42,164 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#55 about to shuffle output of map attempt_local1866321725_0055_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:42,165 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1866321725_0055_m_000000_0
2015-02-10 20:59:42,165 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:42,166 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:42,167 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:42,167 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:42,168 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:42,169 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:42,170 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:42,170 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:42,170 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:42,170 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:42,171 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:42,171 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:42,172 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:42,172 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:42,175 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:42,175 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_RESULTS"]
2015-02-10 20:59:42,183 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:42,184 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:42,186 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1866321725_0055
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:42,189 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local1866321725_0055 state at FAILED
2015-02-10 20:59:42,189 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 20:59:42,189 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 20:59:42,190 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 20:59:42,193 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 20:59:42,193 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...platform/ALL_ARGS_RESULTS
2015-02-10 20:59:42,194 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 20:59:42,194 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_RESULTS/_temporary
2015-02-10 20:59:42,195 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_RESULTS
2015-02-10 20:59:42,210 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:42,211 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:42,214 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_ALL
2015-02-10 20:59:42,229 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:42,230 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:42,234 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:42,235 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:42,236 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:42,239 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:42,239 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:42,239 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_REPLACE"]
2015-02-10 20:59:42,240 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:42,240 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:42,241 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:42,241 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...platform/ALL_ARGS_REPLACE
2015-02-10 20:59:42,242 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:42,243 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:42,267 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:42,285 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:42,299 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local252351053_0056
2015-02-10 20:59:42,315 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity252351053/.staging/job_local252351053_0056/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:42,315 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity252351053/.staging/job_local252351053_0056/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:42,360 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local252351053_0056/job_local252351053_0056.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:42,360 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local252351053_0056/job_local252351053_0056.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:42,361 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:42,361 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:42,362 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:42,361 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local252351053_0056
2015-02-10 20:59:42,362 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:42,363 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:42,364 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local252351053_0056_m_000000_0
2015-02-10 20:59:42,365 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:42,366 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:42,366 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@ea80f3a
2015-02-10 20:59:42,367 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:42,367 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:42,387 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:42,388 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:42,388 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:42,388 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:42,388 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:42,389 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:42,389 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:42,392 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:42,393 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:42,395 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:42,395 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:42,396 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:42,396 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:42,396 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:42,401 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:42,403 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local252351053_0056_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:42,404 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:42,405 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local252351053_0056_m_000000_0' done.
2015-02-10 20:59:42,405 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local252351053_0056_m_000000_0
2015-02-10 20:59:42,405 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:42,406 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:42,406 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local252351053_0056_r_000000_0
2015-02-10 20:59:42,407 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:42,408 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@2c028bbe
2015-02-10 20:59:42,408 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:42,409 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local252351053_0056_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:42,411 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#56 about to shuffle output of map attempt_local252351053_0056_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:42,411 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local252351053_0056_m_000000_0
2015-02-10 20:59:42,411 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:42,412 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:42,413 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:42,413 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:42,415 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:42,415 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:42,416 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:42,417 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:42,417 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:42,417 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:42,418 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:42,418 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:42,419 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:42,419 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:42,422 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:42,423 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_REPLACE"]
2015-02-10 20:59:42,430 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:42,433 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:42,435 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local252351053_0056
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:42,444 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local252351053_0056 state at FAILED
2015-02-10 20:59:42,444 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 20:59:42,444 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 20:59:42,444 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 20:59:42,447 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 20:59:42,448 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...platform/ALL_ARGS_REPLACE
2015-02-10 20:59:42,448 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 20:59:42,449 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_REPLACE/_temporary
2015-02-10 20:59:42,449 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_REPLACE
2015-02-10 20:59:42,464 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:42,465 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:42,469 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:42,471 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:42,471 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:42,474 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:42,474 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:42,474 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_SWAP"]
2015-02-10 20:59:42,474 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  parallel execution is enabled: false
2015-02-10 20:59:42,474 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  starting jobs: 1
2015-02-10 20:59:42,475 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every]  allocating threads: 1
2015-02-10 20:59:42,475 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...blyplatform/ALL_ARGS_SWAP
2015-02-10 20:59:42,476 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:42,477 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:42,500 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:42,517 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:42,531 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1715153079_0057
2015-02-10 20:59:42,547 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1715153079/.staging/job_local1715153079_0057/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:42,548 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1715153079/.staging/job_local1715153079_0057/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:42,591 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1715153079_0057/job_local1715153079_0057.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-02-10 20:59:42,592 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1715153079_0057/job_local1715153079_0057.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-02-10 20:59:42,593 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:42,593 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1715153079_0057
2015-02-10 20:59:42,593 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:42,593 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:42,593 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:42,595 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:42,596 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1715153079_0057_m_000000_0
2015-02-10 20:59:42,597 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:42,598 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:42,598 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@cbc5ae4
2015-02-10 20:59:42,599 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:42,599 INFO  mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:42,617 INFO  mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:42,617 INFO  mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:42,617 INFO  mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:42,617 INFO  mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:42,617 INFO  mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:42,618 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:42,619 INFO  hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:42,622 INFO  hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:42,622 INFO  hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:42,625 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2015-02-10 20:59:42,625 INFO  mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:42,625 INFO  mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:42,625 INFO  mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:42,625 INFO  mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:42,628 INFO  mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:42,630 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1715153079_0057_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:42,631 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:42,631 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1715153079_0057_m_000000_0' done.
2015-02-10 20:59:42,632 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1715153079_0057_m_000000_0
2015-02-10 20:59:42,632 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:42,633 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:42,633 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1715153079_0057_r_000000_0
2015-02-10 20:59:42,634 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:42,634 INFO  mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@2221bcd5
2015-02-10 20:59:42,635 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:42,636 INFO  reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1715153079_0057_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:42,637 INFO  reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#57 about to shuffle output of map attempt_local1715153079_0057_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:42,637 INFO  reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1715153079_0057_m_000000_0
2015-02-10 20:59:42,638 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:42,638 INFO  reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:42,641 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:42,642 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:42,646 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:42,647 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:42,649 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:42,649 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:42,650 INFO  reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:42,650 INFO  mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:42,651 INFO  mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:42,652 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:42,653 INFO  hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:42,653 INFO  hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:42,657 INFO  hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:42,658 INFO  hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_SWAP"]
2015-02-10 20:59:42,665 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:42,666 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:42,668 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1715153079_0057
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
	at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
	at cascading.TestAggregator.complete(TestAggregator.java:96)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
	at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
	at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
	at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
	at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:42,675 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local1715153079_0057 state at FAILED
2015-02-10 20:59:42,675 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 20:59:42,675 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 20:59:42,675 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 20:59:42,678 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 20:59:42,679 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...blyplatform/ALL_ARGS_SWAP
2015-02-10 20:59:42,679 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 20:59:42,680 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_SWAP/_temporary
2015-02-10 20:59:42,680 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_SWAP