2015-02-10 20:59:17,758 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(187)) - found 1 test platforms from classpath
2015-02-10 20:59:17,822 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(237)) - installing platform: hadoop2-mr1
2015-02-10 20:59:17,822 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(238)) - running test: cascading.detail.EveryPipeAssemblyPlatformTest
2015-02-10 20:59:17,940 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:17,958 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:17,969 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:17,980 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:17,991 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:17,991 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,002 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,013 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,013 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,024 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,035 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,036 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,047 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,049 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,049 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,050 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,051 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,051 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,052 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,063 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,063 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,073 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,073 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,084 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,094 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,105 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,115 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,124 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,134 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,134 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,144 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,151 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,152 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,160 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,166 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,167 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,171 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,171 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,172 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,172 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,173 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,173 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,174 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,178 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,178 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,182 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,183 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,187 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,191 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,194 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,199 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,203 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,207 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,208 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,212 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,217 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,218 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,224 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,232 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,232 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,240 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,240 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,241 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,241 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,242 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,242 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,242 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,243 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,243 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,244 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,244 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,245 INFO detail.PipeAssemblyTestBase (PipeAssemblyTestBase.java:makeSuites(90)) - installing platform: hadoop2-mr1
2015-02-10 20:59:18,268 INFO hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(105)) - not using cluster
2015-02-10 20:59:18,909 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2015-02-10 20:59:19,199 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:19,201 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:19,215 INFO property.AppProps (AppProps.java:getAppID(169)) - using app.id: D3AAD3C110B048D3A631EED30C6466C8
2015-02-10 20:59:19,297 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:19,332 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:19,336 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:19,449 INFO util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 2.6.3
2015-02-10 20:59:19,451 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:19,452 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:19,452 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_-1"]
2015-02-10 20:59:19,452 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:19,453 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:19,453 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:19,454 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...blyplatform/-1_'field'_-1
2015-02-10 20:59:19,481 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - session.id is deprecated. Instead, use dfs.metrics.session-id
2015-02-10 20:59:19,482 INFO jvm.JvmMetrics (JvmMetrics.java:init(76)) - Initializing JVM Metrics with processName=JobTracker, sessionId=
2015-02-10 20:59:19,515 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:19,907 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:19,947 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:20,104 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1160515025_0001
2015-02-10 20:59:20,146 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1160515025/.staging/job_local1160515025_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:20,147 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1160515025/.staging/job_local1160515025_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:20,349 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1160515025_0001/job_local1160515025_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:20,350 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1160515025_0001/job_local1160515025_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:20,360 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:20,362 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:20,365 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1160515025_0001
2015-02-10 20:59:20,365 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:20,366 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:20,426 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:20,430 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1160515025_0001_m_000000_0
2015-02-10 20:59:20,473 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:20,483 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:20,484 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@92ca580
2015-02-10 20:59:20,494 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:20,501 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:20,653 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:20,654 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:20,654 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:20,654 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:20,654 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:20,677 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:20,677 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:20,721 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.task.partition is deprecated. Instead, use mapreduce.task.partition
2015-02-10 20:59:20,724 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:20,725 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:20,753 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:20,753 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:20,754 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:20,754 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:20,754 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:20,767 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:20,771 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1160515025_0001_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:20,782 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:20,782 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1160515025_0001_m_000000_0' done.
2015-02-10 20:59:20,782 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1160515025_0001_m_000000_0
2015-02-10 20:59:20,782 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:20,786 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:20,786 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1160515025_0001_r_000000_0
2015-02-10 20:59:20,795 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:20,798 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@3429cf1
2015-02-10 20:59:20,812 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:20,816 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1160515025_0001_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:20,849 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#1 about to shuffle output of map attempt_local1160515025_0001_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:20,854 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1160515025_0001_m_000000_0
2015-02-10 20:59:20,897 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:20,900 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:20,901 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:20,902 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:20,911 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:20,911 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:20,915 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:20,916 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:20,917 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:20,917 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:20,918 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:20,919 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:20,921 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:20,921 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:20,945 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:20,945 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_-1"]
2015-02-10 20:59:20,973 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1160515025_0001_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:20,975 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:20,975 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local1160515025_0001_r_000000_0 is allowed to commit now
2015-02-10 20:59:20,977 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1160515025_0001_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_-1/_temporary/0/task_local1160515025_0001_r_000000
2015-02-10 20:59:20,978 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:20,978 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1160515025_0001_r_000000_0' done.
2015-02-10 20:59:20,979 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1160515025_0001_r_000000_0
2015-02-10 20:59:20,979 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:21,025 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_-1/_temporary
2015-02-10 20:59:21,081 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:21,125 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:21,127 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_'field'_-1
2015-02-10 20:59:21,153 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:21,153 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:21,169 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:21,175 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:21,175 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:21,186 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:21,186 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:21,187 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_'field'"]
2015-02-10 20:59:21,187 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:21,187 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:21,187 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:21,188 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...atform/-1_'field'_'field'
2015-02-10 20:59:21,190 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:21,192 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:21,225 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:21,250 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:21,287 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local737083168_0002
2015-02-10 20:59:21,309 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity737083168/.staging/job_local737083168_0002/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:21,309 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity737083168/.staging/job_local737083168_0002/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:21,397 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local737083168_0002/job_local737083168_0002.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:21,398 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local737083168_0002/job_local737083168_0002.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:21,400 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:21,400 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local737083168_0002
2015-02-10 20:59:21,400 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:21,401 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:21,402 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:21,406 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:21,406 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local737083168_0002_m_000000_0
2015-02-10 20:59:21,410 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:21,412 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:21,412 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@72cc5002
2015-02-10 20:59:21,415 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:21,415 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:21,571 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:21,571 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:21,571 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:21,571 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:21,572 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:21,574 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:21,574 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:21,585 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:21,586 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:21,590 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:21,591 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:21,591 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:21,591 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:21,591 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:21,655 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:21,659 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local737083168_0002_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:21,662 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:21,662 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local737083168_0002_m_000000_0' done.
2015-02-10 20:59:21,662 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local737083168_0002_m_000000_0
2015-02-10 20:59:21,662 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:21,663 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:21,663 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local737083168_0002_r_000000_0
2015-02-10 20:59:21,666 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:21,666 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@16fa21a4
2015-02-10 20:59:21,667 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:21,668 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local737083168_0002_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:21,672 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#2 about to shuffle output of map attempt_local737083168_0002_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:21,673 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local737083168_0002_m_000000_0
2015-02-10 20:59:21,673 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:21,674 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:21,676 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:21,676 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:21,679 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:21,679 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:21,682 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:21,682 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:21,682 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:21,683 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:21,683 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:21,685 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:21,685 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:21,686 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:21,697 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:21,697 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_'field'"]
2015-02-10 20:59:21,716 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local737083168_0002_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:21,718 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:21,719 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local737083168_0002_r_000000_0 is allowed to commit now
2015-02-10 20:59:21,720 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local737083168_0002_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_'field'/_temporary/0/task_local737083168_0002_r_000000
2015-02-10 20:59:21,722 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:21,722 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local737083168_0002_r_000000_0' done.
2015-02-10 20:59:21,722 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local737083168_0002_r_000000_0
2015-02-10 20:59:21,722 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:21,752 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_'field'/_temporary
2015-02-10 20:59:21,794 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:21,838 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:21,840 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_'field'_'field'
2015-02-10 20:59:21,868 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:21,869 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:21,885 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:21,908 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:21,909 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:21,918 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:21,918 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:21,920 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_RESULTS"]
2015-02-10 20:59:21,920 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:21,920 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:21,920 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:21,921 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...atform/-1_'field'_RESULTS
2015-02-10 20:59:21,922 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:21,924 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:21,956 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:21,981 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:22,025 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local889177484_0003
2015-02-10 20:59:22,055 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity889177484/.staging/job_local889177484_0003/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:22,055 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity889177484/.staging/job_local889177484_0003/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:22,132 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local889177484_0003/job_local889177484_0003.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:22,133 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local889177484_0003/job_local889177484_0003.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:22,135 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:22,135 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local889177484_0003
2015-02-10 20:59:22,135 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:22,136 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:22,137 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:22,142 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:22,143 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local889177484_0003_m_000000_0
2015-02-10 20:59:22,146 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:22,148 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:22,149 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@381bd13
2015-02-10 20:59:22,151 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:22,151 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:22,296 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:22,296 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:22,296 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:22,296 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:22,297 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:22,298 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:22,298 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:22,309 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:22,309 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:22,313 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:22,314 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:22,314 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:22,314 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:22,314 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:22,319 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:22,322 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local889177484_0003_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:22,324 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:22,325 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local889177484_0003_m_000000_0' done.
2015-02-10 20:59:22,325 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local889177484_0003_m_000000_0
2015-02-10 20:59:22,325 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:22,326 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:22,326 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local889177484_0003_r_000000_0
2015-02-10 20:59:22,329 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:22,329 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@976484e
2015-02-10 20:59:22,330 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:22,331 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local889177484_0003_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:22,333 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#3 about to shuffle output of map attempt_local889177484_0003_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:22,334 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local889177484_0003_m_000000_0
2015-02-10 20:59:22,334 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:22,335 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:22,336 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:22,336 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:22,339 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:22,339 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:22,343 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:22,344 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:22,344 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:22,344 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:22,344 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:22,345 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:22,346 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:22,346 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:22,356 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:22,356 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_RESULTS"]
2015-02-10 20:59:22,372 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local889177484_0003_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:22,374 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:22,374 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local889177484_0003_r_000000_0 is allowed to commit now
2015-02-10 20:59:22,376 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local889177484_0003_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_RESULTS/_temporary/0/task_local889177484_0003_r_000000
2015-02-10 20:59:22,377 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:22,378 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local889177484_0003_r_000000_0' done.
2015-02-10 20:59:22,378 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local889177484_0003_r_000000_0
2015-02-10 20:59:22,378 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:22,409 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_RESULTS/_temporary
2015-02-10 20:59:22,450 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:22,490 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:22,492 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_'field'_RESULTS
2015-02-10 20:59:22,517 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:22,518 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:22,531 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:22,540 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:22,541 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:22,549 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:22,549 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:22,550 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_ALL"]
2015-02-10 20:59:22,550 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:22,550 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:22,550 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:22,552 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...lyplatform/-1_'field'_ALL
2015-02-10 20:59:22,553 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:22,555 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:22,587 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:22,608 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:22,628 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local222035647_0004
2015-02-10 20:59:22,650 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity222035647/.staging/job_local222035647_0004/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:22,650 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity222035647/.staging/job_local222035647_0004/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:22,718 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local222035647_0004/job_local222035647_0004.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:22,718 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local222035647_0004/job_local222035647_0004.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:22,720 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:22,721 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:22,721 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:22,721 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local222035647_0004
2015-02-10 20:59:22,721 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:22,725 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:22,726 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local222035647_0004_m_000000_0
2015-02-10 20:59:22,729 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:22,732 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:22,732 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@79424b7b
2015-02-10 20:59:22,735 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:22,735 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:22,900 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:22,901 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:22,901 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:22,901 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:22,901 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:22,903 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:22,904 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:22,915 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:22,915 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:22,919 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:22,919 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:22,919 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:22,920 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:22,920 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:22,925 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:22,928 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local222035647_0004_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:22,930 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:22,931 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local222035647_0004_m_000000_0' done.
2015-02-10 20:59:22,931 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local222035647_0004_m_000000_0
2015-02-10 20:59:22,931 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:22,932 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:22,932 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local222035647_0004_r_000000_0
2015-02-10 20:59:22,935 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:22,935 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@42db681c
2015-02-10 20:59:22,936 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:22,937 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local222035647_0004_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:22,939 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#4 about to shuffle output of map attempt_local222035647_0004_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:22,940 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local222035647_0004_m_000000_0
2015-02-10 20:59:22,940 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:22,941 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:22,942 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:22,942 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:22,948 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:22,948 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:22,951 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:22,951 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:22,952 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:22,952 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:22,953 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:22,954 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:22,954 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:22,954 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:22,964 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:22,964 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_ALL"]
2015-02-10 20:59:22,981 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local222035647_0004_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:22,983 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:22,983 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local222035647_0004_r_000000_0 is allowed to commit now
2015-02-10 20:59:22,984 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local222035647_0004_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_ALL/_temporary/0/task_local222035647_0004_r_000000
2015-02-10 20:59:22,986 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:22,986 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local222035647_0004_r_000000_0' done.
2015-02-10 20:59:22,986 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local222035647_0004_r_000000_0
2015-02-10 20:59:22,986 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:23,015 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_ALL/_temporary
2015-02-10 20:59:23,067 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:23,109 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:23,110 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_'field'_ALL
2015-02-10 20:59:23,129 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:23,130 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:23,140 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_'field'_REPLACE
2015-02-10 20:59:23,158 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:23,159 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:23,169 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:23,173 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:23,174 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:23,182 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:23,182 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:23,182 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_SWAP"]
2015-02-10 20:59:23,183 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:23,183 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:23,183 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:23,184 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...yplatform/-1_'field'_SWAP
2015-02-10 20:59:23,185 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:23,186 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:23,214 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:23,235 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:23,268 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local936210493_0005
2015-02-10 20:59:23,287 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity936210493/.staging/job_local936210493_0005/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:23,288 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity936210493/.staging/job_local936210493_0005/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:23,345 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local936210493_0005/job_local936210493_0005.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:23,345 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local936210493_0005/job_local936210493_0005.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:23,348 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:23,348 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:23,349 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:23,349 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local936210493_0005
2015-02-10 20:59:23,350 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:23,354 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:23,354 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local936210493_0005_m_000000_0
2015-02-10 20:59:23,357 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:23,359 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:23,359 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@1116880a
2015-02-10 20:59:23,361 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:23,362 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:23,509 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:23,510 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:23,510 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:23,510 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:23,510 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:23,512 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:23,513 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:23,522 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:23,522 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:23,526 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:23,526 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:23,527 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:23,527 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:23,527 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:23,532 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:23,534 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local936210493_0005_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:23,537 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:23,537 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local936210493_0005_m_000000_0' done.
2015-02-10 20:59:23,537 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local936210493_0005_m_000000_0
2015-02-10 20:59:23,538 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:23,538 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:23,538 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local936210493_0005_r_000000_0
2015-02-10 20:59:23,541 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:23,541 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@1e753c22
2015-02-10 20:59:23,542 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:23,542 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local936210493_0005_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:23,544 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#5 about to shuffle output of map attempt_local936210493_0005_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:23,545 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local936210493_0005_m_000000_0
2015-02-10 20:59:23,545 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:23,546 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:23,547 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:23,547 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:23,551 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:23,551 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:23,553 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:23,553 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:23,554 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:23,554 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:23,554 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:23,555 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:23,555 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:23,555 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:23,564 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:23,564 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_SWAP"]
2015-02-10 20:59:23,579 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local936210493_0005_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:23,581 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:23,581 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local936210493_0005_r_000000_0 is allowed to commit now
2015-02-10 20:59:23,582 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local936210493_0005_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_SWAP/_temporary/0/task_local936210493_0005_r_000000
2015-02-10 20:59:23,584 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:23,584 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local936210493_0005_r_000000_0' done.
2015-02-10 20:59:23,584 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local936210493_0005_r_000000_0
2015-02-10 20:59:23,585 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:23,614 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_'field'_SWAP/_temporary
2015-02-10 20:59:23,648 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:23,975 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:23,977 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_'field'_SWAP
2015-02-10 20:59:23,998 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:23,999 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:24,009 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:24,013 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:24,014 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:24,021 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:24,022 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:24,023 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_-1"]
2015-02-10 20:59:24,024 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:24,025 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:24,026 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:24,028 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...blyplatform/-1_UNKNOWN_-1
2015-02-10 20:59:24,028 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:24,030 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:24,058 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:24,078 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:24,096 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1348329142_0006
2015-02-10 20:59:24,116 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1348329142/.staging/job_local1348329142_0006/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:24,117 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1348329142/.staging/job_local1348329142_0006/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:24,172 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1348329142_0006/job_local1348329142_0006.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:24,172 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1348329142_0006/job_local1348329142_0006.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:24,173 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:24,175 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1348329142_0006
2015-02-10 20:59:24,175 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:24,175 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:24,176 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:24,179 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:24,179 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1348329142_0006_m_000000_0
2015-02-10 20:59:24,181 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:24,183 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:24,183 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@6876fb1b
2015-02-10 20:59:24,184 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:24,185 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:24,255 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:24,255 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:24,256 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:24,256 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:24,256 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:24,258 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:24,259 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:24,267 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:24,268 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:24,272 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:24,272 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:24,272 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:24,272 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:24,272 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:24,276 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:24,279 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1348329142_0006_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:24,281 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:24,281 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1348329142_0006_m_000000_0' done.
2015-02-10 20:59:24,282 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1348329142_0006_m_000000_0
2015-02-10 20:59:24,282 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:24,283 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:24,283 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1348329142_0006_r_000000_0
2015-02-10 20:59:24,285 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:24,285 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@7b76fb04
2015-02-10 20:59:24,286 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:24,287 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1348329142_0006_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:24,289 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#6 about to shuffle output of map attempt_local1348329142_0006_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:24,290 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1348329142_0006_m_000000_0
2015-02-10 20:59:24,290 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:24,290 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:24,291 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:24,292 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:24,294 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:24,294 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:24,296 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:24,297 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:24,297 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:24,297 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:24,298 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:24,298 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:24,299 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:24,299 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:24,307 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:24,307 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_-1"]
2015-02-10 20:59:24,322 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1348329142_0006_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:24,324 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:24,325 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local1348329142_0006_r_000000_0 is allowed to commit now
2015-02-10 20:59:24,326 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1348329142_0006_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_-1/_temporary/0/task_local1348329142_0006_r_000000
2015-02-10 20:59:24,328 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:24,328 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1348329142_0006_r_000000_0' done.
2015-02-10 20:59:24,329 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1348329142_0006_r_000000_0
2015-02-10 20:59:24,329 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:24,349 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_-1/_temporary
2015-02-10 20:59:24,381 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:24,416 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:24,418 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_-1
2015-02-10 20:59:24,437 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:24,437 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:24,446 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_'field'
2015-02-10 20:59:24,468 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:24,469 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:24,479 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:24,482 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:24,483 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:24,490 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:24,490 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:24,491 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_RESULTS"]
2015-02-10 20:59:24,491 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:24,492 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:24,492 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:24,493 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...atform/-1_UNKNOWN_RESULTS
2015-02-10 20:59:24,494 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:24,495 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:24,523 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:24,544 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:24,560 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1737186709_0007
2015-02-10 20:59:24,581 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1737186709/.staging/job_local1737186709_0007/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:24,581 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1737186709/.staging/job_local1737186709_0007/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:24,634 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1737186709_0007/job_local1737186709_0007.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:24,634 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1737186709_0007/job_local1737186709_0007.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:24,636 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:24,636 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1737186709_0007
2015-02-10 20:59:24,636 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:24,636 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:24,637 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:24,641 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:24,641 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1737186709_0007_m_000000_0
2015-02-10 20:59:24,643 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:24,645 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:24,646 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@4f4a1ab7
2015-02-10 20:59:24,647 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:24,648 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:24,798 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:24,798 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:24,798 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:24,799 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:24,799 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:24,801 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:24,801 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:24,809 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:24,809 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:24,813 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:24,814 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:24,814 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:24,814 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:24,814 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:24,820 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:24,822 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1737186709_0007_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:24,825 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:24,825 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1737186709_0007_m_000000_0' done.
2015-02-10 20:59:24,825 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1737186709_0007_m_000000_0
2015-02-10 20:59:24,825 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:24,826 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:24,826 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1737186709_0007_r_000000_0
2015-02-10 20:59:24,828 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:24,828 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@682f8c99
2015-02-10 20:59:24,829 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:24,830 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1737186709_0007_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:24,832 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#7 about to shuffle output of map attempt_local1737186709_0007_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:24,833 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1737186709_0007_m_000000_0
2015-02-10 20:59:24,833 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:24,834 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:24,835 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:24,835 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:24,840 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:24,840 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:24,842 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:24,842 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:24,843 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:24,843 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:24,843 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:24,844 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:24,845 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:24,845 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:24,854 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:24,854 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_RESULTS"]
2015-02-10 20:59:24,868 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1737186709_0007_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:24,870 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:24,870 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local1737186709_0007_r_000000_0 is allowed to commit now
2015-02-10 20:59:24,871 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1737186709_0007_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_RESULTS/_temporary/0/task_local1737186709_0007_r_000000
2015-02-10 20:59:24,873 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:24,873 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1737186709_0007_r_000000_0' done.
2015-02-10 20:59:24,873 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1737186709_0007_r_000000_0
2015-02-10 20:59:24,873 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:24,897 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_RESULTS/_temporary
2015-02-10 20:59:24,930 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:24,963 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:24,965 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_RESULTS
2015-02-10 20:59:24,984 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:24,985 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:24,998 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:25,001 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:25,002 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:25,010 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:25,011 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:25,011 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_ALL"]
2015-02-10 20:59:25,011 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:25,011 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:25,011 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:25,012 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...lyplatform/-1_UNKNOWN_ALL
2015-02-10 20:59:25,013 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:25,014 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:25,043 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:25,065 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:25,086 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local468581826_0008
2015-02-10 20:59:25,106 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity468581826/.staging/job_local468581826_0008/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:25,106 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity468581826/.staging/job_local468581826_0008/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:25,159 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local468581826_0008/job_local468581826_0008.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:25,160 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local468581826_0008/job_local468581826_0008.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:25,161 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:25,163 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local468581826_0008
2015-02-10 20:59:25,163 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:25,163 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:25,164 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:25,167 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:25,168 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local468581826_0008_m_000000_0
2015-02-10 20:59:25,170 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:25,171 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:25,171 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@302b2c81
2015-02-10 20:59:25,173 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:25,173 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:25,315 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:25,316 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:25,316 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:25,316 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:25,316 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:25,317 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:25,317 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:25,325 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:25,325 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:25,329 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:25,329 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:25,329 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:25,329 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:25,329 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:25,333 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:25,335 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local468581826_0008_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:25,338 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:25,338 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local468581826_0008_m_000000_0' done.
2015-02-10 20:59:25,338 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local468581826_0008_m_000000_0
2015-02-10 20:59:25,338 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:25,339 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:25,339 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local468581826_0008_r_000000_0
2015-02-10 20:59:25,341 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:25,342 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@32a88bc2
2015-02-10 20:59:25,342 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:25,343 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local468581826_0008_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:25,345 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#8 about to shuffle output of map attempt_local468581826_0008_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:25,346 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local468581826_0008_m_000000_0
2015-02-10 20:59:25,346 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:25,346 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:25,348 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:25,348 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:25,351 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:25,351 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:25,353 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:25,354 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:25,354 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:25,354 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:25,354 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:25,355 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:25,355 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:25,356 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:25,362 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:25,363 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_ALL"]
2015-02-10 20:59:25,377 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local468581826_0008_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:25,379 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:25,379 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local468581826_0008_r_000000_0 is allowed to commit now
2015-02-10 20:59:25,380 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local468581826_0008_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_ALL/_temporary/0/task_local468581826_0008_r_000000
2015-02-10 20:59:25,381 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:25,381 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local468581826_0008_r_000000_0' done.
2015-02-10 20:59:25,382 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local468581826_0008_r_000000_0
2015-02-10 20:59:25,382 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:25,404 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_ALL/_temporary
2015-02-10 20:59:25,435 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:25,468 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:25,470 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_ALL
2015-02-10 20:59:25,487 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:25,488 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:25,497 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:25,499 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:25,500 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:25,506 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:25,507 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:25,507 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_REPLACE"]
2015-02-10 20:59:25,507 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:25,507 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:25,507 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:25,508 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...atform/-1_UNKNOWN_REPLACE
2015-02-10 20:59:25,509 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:25,510 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:25,538 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:25,560 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:25,577 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local20909324_0009
2015-02-10 20:59:25,597 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity20909324/.staging/job_local20909324_0009/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:25,597 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity20909324/.staging/job_local20909324_0009/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:25,663 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local20909324_0009/job_local20909324_0009.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:25,663 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local20909324_0009/job_local20909324_0009.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:25,665 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:25,665 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local20909324_0009
2015-02-10 20:59:25,665 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:25,665 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:25,666 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:25,671 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:25,671 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local20909324_0009_m_000000_0
2015-02-10 20:59:25,674 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:25,676 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:25,676 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@5ac2480b
2015-02-10 20:59:25,678 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:25,678 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:25,821 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:25,821 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:25,821 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:25,821 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:25,821 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:25,823 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:25,823 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:25,831 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:25,831 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:25,835 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:25,835 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:25,835 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:25,836 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:25,836 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:25,840 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:25,843 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local20909324_0009_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:25,845 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:25,845 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local20909324_0009_m_000000_0' done.
2015-02-10 20:59:25,846 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local20909324_0009_m_000000_0
2015-02-10 20:59:25,846 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:25,847 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:25,847 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local20909324_0009_r_000000_0
2015-02-10 20:59:25,849 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:25,849 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@7559f3f0
2015-02-10 20:59:25,850 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:25,851 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local20909324_0009_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:25,854 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#9 about to shuffle output of map attempt_local20909324_0009_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:25,854 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local20909324_0009_m_000000_0
2015-02-10 20:59:25,855 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:25,855 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:25,857 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:25,857 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:25,859 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:25,860 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:25,862 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:25,862 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:25,862 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:25,862 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:25,863 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:25,864 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:25,864 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:25,864 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:25,872 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:25,872 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_REPLACE"]
2015-02-10 20:59:25,884 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:25,887 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:25,890 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local20909324_0009
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:25,900 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local20909324_0009 state at FAILED
2015-02-10 20:59:25,900 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 20:59:25,901 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 20:59:25,901 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 20:59:25,908 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 20:59:25,909 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...atform/-1_UNKNOWN_REPLACE
2015-02-10 20:59:25,911 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 20:59:25,912 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_REPLACE/_temporary
2015-02-10 20:59:25,912 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_REPLACE
2015-02-10 20:59:25,950 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:25,952 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:25,961 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:25,964 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:25,965 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:25,971 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:25,972 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:25,972 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_SWAP"]
2015-02-10 20:59:25,973 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:25,973 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:25,974 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:25,975 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...yplatform/-1_UNKNOWN_SWAP
2015-02-10 20:59:25,976 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:25,977 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:26,003 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:26,022 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:26,040 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local641546413_0010
2015-02-10 20:59:26,062 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity641546413/.staging/job_local641546413_0010/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:26,062 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity641546413/.staging/job_local641546413_0010/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:26,115 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local641546413_0010/job_local641546413_0010.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:26,115 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local641546413_0010/job_local641546413_0010.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:26,116 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:26,117 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local641546413_0010
2015-02-10 20:59:26,117 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:26,117 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:26,117 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:26,121 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:26,121 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local641546413_0010_m_000000_0
2015-02-10 20:59:26,123 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:26,125 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:26,125 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@3ac803e6
2015-02-10 20:59:26,127 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:26,127 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:26,284 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:26,284 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:26,284 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:26,284 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:26,284 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:26,286 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:26,286 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:26,293 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:26,294 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:26,298 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:26,298 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:26,298 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:26,298 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:26,298 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:26,303 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:26,305 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local641546413_0010_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:26,307 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:26,307 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local641546413_0010_m_000000_0' done.
2015-02-10 20:59:26,307 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local641546413_0010_m_000000_0
2015-02-10 20:59:26,308 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:26,308 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:26,309 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local641546413_0010_r_000000_0
2015-02-10 20:59:26,311 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:26,311 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@57543bc5
2015-02-10 20:59:26,312 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:26,314 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local641546413_0010_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:26,316 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#10 about to shuffle output of map attempt_local641546413_0010_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:26,316 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local641546413_0010_m_000000_0
2015-02-10 20:59:26,317 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:26,317 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:26,318 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:26,319 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:26,323 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:26,324 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:26,326 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:26,326 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:26,326 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:26,326 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:26,327 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:26,327 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:26,328 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:26,328 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:26,335 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:26,336 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_SWAP"]
2015-02-10 20:59:26,350 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local641546413_0010_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:26,352 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:26,352 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local641546413_0010_r_000000_0 is allowed to commit now
2015-02-10 20:59:26,353 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local641546413_0010_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_SWAP/_temporary/0/task_local641546413_0010_r_000000
2015-02-10 20:59:26,354 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:26,355 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local641546413_0010_r_000000_0' done.
2015-02-10 20:59:26,355 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local641546413_0010_r_000000_0
2015-02-10 20:59:26,355 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:26,378 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_SWAP/_temporary
2015-02-10 20:59:26,409 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:26,442 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:26,443 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_UNKNOWN_SWAP
2015-02-10 20:59:26,461 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:26,462 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:26,470 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:26,474 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:26,475 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:26,481 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:26,481 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:26,481 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_-1"]
2015-02-10 20:59:26,481 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:26,482 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:26,482 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:26,482 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...mblyplatform/-1_VALUES_-1
2015-02-10 20:59:26,483 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:26,484 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:26,509 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:26,528 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:26,544 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local356800678_0011
2015-02-10 20:59:26,565 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity356800678/.staging/job_local356800678_0011/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:26,565 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity356800678/.staging/job_local356800678_0011/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:26,688 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local356800678_0011/job_local356800678_0011.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:26,688 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local356800678_0011/job_local356800678_0011.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:26,690 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:26,690 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local356800678_0011
2015-02-10 20:59:26,690 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:26,691 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:26,691 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:26,695 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:26,695 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local356800678_0011_m_000000_0
2015-02-10 20:59:26,697 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:26,699 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:26,700 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@4fe7f80
2015-02-10 20:59:26,701 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:26,702 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:27,020 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:27,021 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:27,022 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:27,022 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:27,023 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:27,025 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:27,025 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:27,033 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:27,034 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:27,038 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:27,039 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:27,039 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:27,040 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:27,040 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:27,044 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:27,046 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local356800678_0011_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:27,049 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:27,049 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local356800678_0011_m_000000_0' done.
2015-02-10 20:59:27,050 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local356800678_0011_m_000000_0
2015-02-10 20:59:27,050 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:27,051 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:27,051 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local356800678_0011_r_000000_0
2015-02-10 20:59:27,053 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:27,053 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@2543472c
2015-02-10 20:59:27,054 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:27,055 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local356800678_0011_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:27,057 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#11 about to shuffle output of map attempt_local356800678_0011_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:27,057 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local356800678_0011_m_000000_0
2015-02-10 20:59:27,057 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:27,058 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:27,060 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:27,061 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:27,064 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:27,066 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:27,068 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:27,068 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:27,069 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:27,069 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:27,070 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:27,071 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:27,071 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:27,072 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:27,078 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:27,079 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_-1"]
2015-02-10 20:59:27,090 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:27,091 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:27,093 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local356800678_0011
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:27,099 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local356800678_0011 state at FAILED
2015-02-10 20:59:27,099 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 20:59:27,099 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 20:59:27,099 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 20:59:27,106 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 20:59:27,106 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...mblyplatform/-1_VALUES_-1
2015-02-10 20:59:27,107 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 20:59:27,107 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_-1/_temporary
2015-02-10 20:59:27,107 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_-1
2015-02-10 20:59:27,125 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:27,126 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:27,132 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_'field'
2015-02-10 20:59:27,149 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:27,150 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:27,158 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:27,160 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:27,161 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:27,166 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:27,167 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:27,167 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_RESULTS"]
2015-02-10 20:59:27,168 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:27,168 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:27,168 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:27,170 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...latform/-1_VALUES_RESULTS
2015-02-10 20:59:27,170 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:27,171 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:27,196 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:27,215 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:27,230 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local317740006_0012
2015-02-10 20:59:27,248 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity317740006/.staging/job_local317740006_0012/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:27,248 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity317740006/.staging/job_local317740006_0012/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:27,297 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local317740006_0012/job_local317740006_0012.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:27,298 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local317740006_0012/job_local317740006_0012.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:27,299 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:27,299 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local317740006_0012
2015-02-10 20:59:27,299 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:27,300 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:27,300 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:27,303 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:27,303 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local317740006_0012_m_000000_0
2015-02-10 20:59:27,305 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:27,306 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:27,306 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@45d45d18
2015-02-10 20:59:27,308 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:27,308 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:27,457 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:27,457 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:27,458 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:27,458 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:27,458 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:27,460 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:27,461 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:27,471 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:27,472 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:27,476 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:27,476 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:27,476 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:27,476 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:27,477 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:27,480 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:27,483 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local317740006_0012_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:27,485 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:27,485 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local317740006_0012_m_000000_0' done.
2015-02-10 20:59:27,485 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local317740006_0012_m_000000_0
2015-02-10 20:59:27,485 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:27,486 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:27,486 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local317740006_0012_r_000000_0
2015-02-10 20:59:27,489 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:27,489 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@305f6ed4
2015-02-10 20:59:27,489 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:27,490 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local317740006_0012_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:27,492 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#12 about to shuffle output of map attempt_local317740006_0012_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:27,493 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local317740006_0012_m_000000_0
2015-02-10 20:59:27,493 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:27,494 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:27,495 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:27,495 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:27,499 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:27,499 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:27,501 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:27,501 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:27,501 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:27,501 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:27,502 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:27,502 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:27,503 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:27,503 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:27,509 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:27,510 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_RESULTS"]
2015-02-10 20:59:27,519 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:27,520 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:27,522 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local317740006_0012
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:27,523 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local317740006_0012 state at FAILED
2015-02-10 20:59:27,523 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 20:59:27,523 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 20:59:27,523 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 20:59:27,530 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 20:59:27,532 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...latform/-1_VALUES_RESULTS
2015-02-10 20:59:27,532 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 20:59:27,532 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] shutting down job executor
2015-02-10 20:59:27,533 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] shutdown complete
2015-02-10 20:59:27,534 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_RESULTS/_temporary
2015-02-10 20:59:27,534 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_RESULTS
2015-02-10 20:59:27,552 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:27,552 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:27,560 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:27,562 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:27,563 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:27,568 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:27,568 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:27,568 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_ALL"]
2015-02-10 20:59:27,568 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:27,568 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:27,568 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:27,569 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...blyplatform/-1_VALUES_ALL
2015-02-10 20:59:27,570 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:27,571 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:27,596 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:27,615 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:27,631 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local413056919_0013
2015-02-10 20:59:27,649 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity413056919/.staging/job_local413056919_0013/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:27,650 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity413056919/.staging/job_local413056919_0013/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:27,700 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local413056919_0013/job_local413056919_0013.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:27,701 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local413056919_0013/job_local413056919_0013.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:27,702 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:27,702 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local413056919_0013
2015-02-10 20:59:27,702 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:27,702 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:27,703 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:27,705 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:27,706 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local413056919_0013_m_000000_0
2015-02-10 20:59:27,707 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:27,709 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:27,709 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@6c696d5c
2015-02-10 20:59:27,710 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:27,711 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:27,854 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:27,854 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:27,854 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:27,855 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:27,855 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:27,856 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:27,856 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:27,863 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:27,863 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:27,867 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:27,867 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:27,867 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:27,868 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:27,868 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:27,871 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:27,873 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local413056919_0013_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:27,875 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:27,875 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local413056919_0013_m_000000_0' done.
2015-02-10 20:59:27,876 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local413056919_0013_m_000000_0
2015-02-10 20:59:27,876 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:27,876 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:27,877 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local413056919_0013_r_000000_0
2015-02-10 20:59:27,878 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:27,879 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@6ecb741e
2015-02-10 20:59:27,879 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:27,880 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local413056919_0013_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:27,882 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#13 about to shuffle output of map attempt_local413056919_0013_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:27,883 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local413056919_0013_m_000000_0
2015-02-10 20:59:27,883 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:27,884 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:27,885 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:27,885 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:27,896 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:27,896 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:27,898 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:27,898 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:27,898 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:27,898 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:27,899 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:27,900 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:27,900 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:27,900 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:27,907 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:27,907 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_ALL"]
2015-02-10 20:59:27,916 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:27,917 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:27,919 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local413056919_0013
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:27,921 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local413056919_0013 state at FAILED
2015-02-10 20:59:27,922 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 20:59:27,922 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 20:59:27,922 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 20:59:27,928 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 20:59:27,929 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...blyplatform/-1_VALUES_ALL
2015-02-10 20:59:27,929 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 20:59:27,929 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] shutting down job executor
2015-02-10 20:59:27,930 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] shutdown complete
2015-02-10 20:59:27,931 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_ALL/_temporary
2015-02-10 20:59:27,931 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_ALL
2015-02-10 20:59:27,949 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:27,949 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:27,957 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:27,959 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:27,959 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:27,964 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:27,964 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:27,964 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_REPLACE"]
2015-02-10 20:59:27,964 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:27,965 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:27,965 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:27,966 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...latform/-1_VALUES_REPLACE
2015-02-10 20:59:27,967 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:27,968 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:27,994 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:28,013 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:28,028 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1967334461_0014
2015-02-10 20:59:28,047 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1967334461/.staging/job_local1967334461_0014/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:28,048 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1967334461/.staging/job_local1967334461_0014/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:28,097 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1967334461_0014/job_local1967334461_0014.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:28,098 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1967334461_0014/job_local1967334461_0014.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:28,099 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:28,100 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:28,101 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:28,100 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1967334461_0014
2015-02-10 20:59:28,102 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:28,103 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:28,103 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1967334461_0014_m_000000_0
2015-02-10 20:59:28,105 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:28,107 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:28,107 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@585353c8
2015-02-10 20:59:28,108 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:28,109 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:28,252 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:28,253 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:28,253 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:28,253 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:28,254 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:28,255 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:28,255 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:28,262 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:28,263 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:28,267 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:28,267 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:28,267 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:28,268 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:28,268 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:28,272 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:28,273 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1967334461_0014_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:28,276 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:28,276 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1967334461_0014_m_000000_0' done.
2015-02-10 20:59:28,276 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1967334461_0014_m_000000_0
2015-02-10 20:59:28,277 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:28,278 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:28,278 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1967334461_0014_r_000000_0
2015-02-10 20:59:28,280 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:28,280 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@5bc5d0e0
2015-02-10 20:59:28,281 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:28,282 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1967334461_0014_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:28,284 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#14 about to shuffle output of map attempt_local1967334461_0014_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:28,285 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1967334461_0014_m_000000_0
2015-02-10 20:59:28,285 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:28,286 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:28,287 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:28,287 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:28,290 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:28,290 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:28,292 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:28,292 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:28,293 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:28,293 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:28,293 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:28,294 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:28,295 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:28,295 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:28,302 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:28,302 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_REPLACE"]
2015-02-10 20:59:28,311 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:28,312 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:28,314 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1967334461_0014
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:28,316 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local1967334461_0014 state at FAILED
2015-02-10 20:59:28,316 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 20:59:28,316 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 20:59:28,316 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 20:59:28,323 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 20:59:28,323 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...latform/-1_VALUES_REPLACE
2015-02-10 20:59:28,324 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 20:59:28,324 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_REPLACE/_temporary
2015-02-10 20:59:28,324 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_REPLACE
2015-02-10 20:59:28,342 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:28,342 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:28,350 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:28,351 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:28,352 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:28,356 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:28,357 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:28,357 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_SWAP"]
2015-02-10 20:59:28,357 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:28,357 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:28,357 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:28,358 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...lyplatform/-1_VALUES_SWAP
2015-02-10 20:59:28,358 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:28,359 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:28,383 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:28,401 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:28,416 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1713309805_0015
2015-02-10 20:59:28,434 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1713309805/.staging/job_local1713309805_0015/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:28,435 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1713309805/.staging/job_local1713309805_0015/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:28,482 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1713309805_0015/job_local1713309805_0015.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:28,483 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1713309805_0015/job_local1713309805_0015.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:28,484 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:28,485 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:28,485 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:28,485 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1713309805_0015
2015-02-10 20:59:28,485 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:28,487 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:28,488 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1713309805_0015_m_000000_0
2015-02-10 20:59:28,489 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:28,491 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:28,491 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@6810a098
2015-02-10 20:59:28,492 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:28,492 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:28,758 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:28,759 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:28,759 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:28,759 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:28,759 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:28,760 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:28,760 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:28,767 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:28,767 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:28,771 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:28,772 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:28,772 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:28,772 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:28,772 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:28,775 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:28,777 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1713309805_0015_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:28,779 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:28,779 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1713309805_0015_m_000000_0' done.
2015-02-10 20:59:28,779 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1713309805_0015_m_000000_0
2015-02-10 20:59:28,780 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:28,780 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:28,780 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1713309805_0015_r_000000_0
2015-02-10 20:59:28,782 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:28,782 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@2210a0e
2015-02-10 20:59:28,783 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:28,784 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1713309805_0015_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:28,786 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#15 about to shuffle output of map attempt_local1713309805_0015_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:28,786 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1713309805_0015_m_000000_0
2015-02-10 20:59:28,786 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:28,787 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:28,788 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:28,789 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:28,791 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:28,791 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:28,792 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:28,793 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:28,793 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:28,793 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:28,796 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:28,798 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:28,798 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:28,798 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:28,805 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:28,806 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_SWAP"]
2015-02-10 20:59:28,814 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:28,815 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:28,817 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1713309805_0015
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:28,823 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local1713309805_0015 state at FAILED
2015-02-10 20:59:28,823 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 20:59:28,823 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 20:59:28,824 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 20:59:28,829 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 20:59:28,830 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...lyplatform/-1_VALUES_SWAP
2015-02-10 20:59:28,831 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 20:59:28,831 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_SWAP/_temporary
2015-02-10 20:59:28,831 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_VALUES_SWAP
2015-02-10 20:59:28,849 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:28,849 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:28,857 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:28,859 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:28,859 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:28,864 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:28,864 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:28,864 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_-1"]
2015-02-10 20:59:28,864 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:28,865 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:28,865 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:28,866 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...semblyplatform/-1_ARGS_-1
2015-02-10 20:59:28,867 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:28,868 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:28,895 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:28,914 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:28,930 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1738851200_0016
2015-02-10 20:59:28,950 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1738851200/.staging/job_local1738851200_0016/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:28,950 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1738851200/.staging/job_local1738851200_0016/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:29,002 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1738851200_0016/job_local1738851200_0016.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:29,002 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1738851200_0016/job_local1738851200_0016.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:29,003 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:29,004 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1738851200_0016
2015-02-10 20:59:29,005 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:29,004 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:29,005 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:29,008 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:29,008 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1738851200_0016_m_000000_0
2015-02-10 20:59:29,010 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:29,012 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:29,012 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@15a08be5
2015-02-10 20:59:29,013 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:29,014 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:29,165 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:29,165 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:29,165 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:29,166 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:29,166 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:29,168 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:29,168 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:29,175 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:29,175 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:29,179 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:29,179 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:29,179 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:29,179 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:29,179 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:29,183 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:29,185 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1738851200_0016_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:29,187 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:29,187 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1738851200_0016_m_000000_0' done.
2015-02-10 20:59:29,187 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1738851200_0016_m_000000_0
2015-02-10 20:59:29,187 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:29,188 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:29,188 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1738851200_0016_r_000000_0
2015-02-10 20:59:29,190 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:29,190 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@7c8e3f75
2015-02-10 20:59:29,191 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:29,192 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1738851200_0016_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:29,194 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#16 about to shuffle output of map attempt_local1738851200_0016_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:29,195 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1738851200_0016_m_000000_0
2015-02-10 20:59:29,195 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:29,196 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:29,197 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:29,197 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:29,201 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:29,201 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:29,203 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:29,204 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:29,204 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:29,204 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:29,205 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:29,205 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:29,206 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:29,206 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:29,213 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:29,213 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_-1"]
2015-02-10 20:59:29,226 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1738851200_0016_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:29,228 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:29,228 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local1738851200_0016_r_000000_0 is allowed to commit now
2015-02-10 20:59:29,229 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1738851200_0016_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_-1/_temporary/0/task_local1738851200_0016_r_000000
2015-02-10 20:59:29,230 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:29,230 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1738851200_0016_r_000000_0' done.
2015-02-10 20:59:29,230 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1738851200_0016_r_000000_0
2015-02-10 20:59:29,230 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:29,245 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_-1/_temporary
2015-02-10 20:59:29,276 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:29,308 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:29,309 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_-1
2015-02-10 20:59:29,326 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:29,327 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:29,333 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_'field'
2015-02-10 20:59:29,351 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:29,351 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:29,359 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:29,361 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:29,361 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:29,366 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:29,366 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:29,366 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_RESULTS"]
2015-02-10 20:59:29,366 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:29,366 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:29,367 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:29,367 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...yplatform/-1_ARGS_RESULTS
2015-02-10 20:59:29,368 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:29,369 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:29,395 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:29,413 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:29,428 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1569438270_0017
2015-02-10 20:59:29,446 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1569438270/.staging/job_local1569438270_0017/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:29,446 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1569438270/.staging/job_local1569438270_0017/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:29,502 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1569438270_0017/job_local1569438270_0017.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:29,502 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1569438270_0017/job_local1569438270_0017.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:29,504 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:29,505 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:29,505 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:29,505 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1569438270_0017
2015-02-10 20:59:29,506 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:29,508 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:29,508 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1569438270_0017_m_000000_0
2015-02-10 20:59:29,510 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:29,512 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:29,512 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@30c2ea0b
2015-02-10 20:59:29,513 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:29,513 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:29,667 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:29,668 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:29,668 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:29,668 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:29,668 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:29,669 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:29,669 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:29,677 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:29,678 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:29,682 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:29,682 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:29,682 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:29,682 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:29,682 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:29,686 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:29,688 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1569438270_0017_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:29,690 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:29,690 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1569438270_0017_m_000000_0' done.
2015-02-10 20:59:29,690 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1569438270_0017_m_000000_0
2015-02-10 20:59:29,690 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:29,691 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:29,691 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1569438270_0017_r_000000_0
2015-02-10 20:59:29,693 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:29,693 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@2f971f66
2015-02-10 20:59:29,695 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:29,696 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1569438270_0017_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:29,697 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#17 about to shuffle output of map attempt_local1569438270_0017_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:29,698 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1569438270_0017_m_000000_0
2015-02-10 20:59:29,698 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:29,699 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:29,700 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:29,700 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:29,703 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:29,703 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:29,704 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:29,705 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:29,705 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:29,705 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:29,706 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:29,706 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:29,707 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:29,707 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:29,714 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:29,714 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_RESULTS"]
2015-02-10 20:59:29,728 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1569438270_0017_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:29,730 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:29,730 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local1569438270_0017_r_000000_0 is allowed to commit now
2015-02-10 20:59:29,731 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1569438270_0017_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_RESULTS/_temporary/0/task_local1569438270_0017_r_000000
2015-02-10 20:59:29,732 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:29,732 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1569438270_0017_r_000000_0' done.
2015-02-10 20:59:29,732 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1569438270_0017_r_000000_0
2015-02-10 20:59:29,733 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:29,761 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_RESULTS/_temporary
2015-02-10 20:59:29,792 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:29,822 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:29,824 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_RESULTS
2015-02-10 20:59:29,840 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:29,840 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:29,847 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_ALL
2015-02-10 20:59:29,863 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:29,864 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:29,870 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:29,872 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:29,872 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:29,877 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:29,877 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:29,877 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_REPLACE"]
2015-02-10 20:59:29,878 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:29,878 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:29,878 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:29,878 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...yplatform/-1_ARGS_REPLACE
2015-02-10 20:59:29,879 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:29,880 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:29,904 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:29,922 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:29,937 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local2021745132_0018
2015-02-10 20:59:29,954 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity2021745132/.staging/job_local2021745132_0018/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:29,955 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity2021745132/.staging/job_local2021745132_0018/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:30,005 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2021745132_0018/job_local2021745132_0018.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:30,006 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2021745132_0018/job_local2021745132_0018.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:30,008 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:30,008 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:30,009 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:30,008 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local2021745132_0018
2015-02-10 20:59:30,010 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:30,011 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:30,011 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local2021745132_0018_m_000000_0
2015-02-10 20:59:30,013 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:30,014 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:30,014 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@33ff9a48
2015-02-10 20:59:30,015 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:30,016 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:30,158 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:30,158 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:30,159 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:30,159 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:30,159 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:30,160 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:30,160 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:30,167 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:30,167 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:30,171 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:30,171 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:30,172 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:30,172 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:30,172 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:30,175 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:30,177 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local2021745132_0018_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:30,179 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:30,180 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local2021745132_0018_m_000000_0' done.
2015-02-10 20:59:30,180 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local2021745132_0018_m_000000_0
2015-02-10 20:59:30,180 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:30,181 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:30,181 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local2021745132_0018_r_000000_0
2015-02-10 20:59:30,183 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:30,183 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@523bd44c
2015-02-10 20:59:30,184 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:30,185 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local2021745132_0018_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:30,187 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#18 about to shuffle output of map attempt_local2021745132_0018_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:30,187 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local2021745132_0018_m_000000_0
2015-02-10 20:59:30,187 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:30,188 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:30,189 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:30,190 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:30,192 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:30,192 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:30,194 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:30,194 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:30,195 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:30,195 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:30,195 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:30,196 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:30,197 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:30,197 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:30,203 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:30,204 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_REPLACE"]
2015-02-10 20:59:30,216 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local2021745132_0018_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:30,218 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:30,218 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local2021745132_0018_r_000000_0 is allowed to commit now
2015-02-10 20:59:30,219 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local2021745132_0018_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_REPLACE/_temporary/0/task_local2021745132_0018_r_000000
2015-02-10 20:59:30,220 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:30,221 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local2021745132_0018_r_000000_0' done.
2015-02-10 20:59:30,221 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local2021745132_0018_r_000000_0
2015-02-10 20:59:30,221 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:30,240 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_REPLACE/_temporary
2015-02-10 20:59:30,269 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:30,300 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:30,302 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_REPLACE
2015-02-10 20:59:30,318 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:30,319 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:30,325 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:30,327 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:30,327 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:30,331 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:30,332 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:30,332 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_SWAP"]
2015-02-10 20:59:30,333 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:30,333 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:30,333 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:30,334 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...mblyplatform/-1_ARGS_SWAP
2015-02-10 20:59:30,335 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:30,336 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:30,360 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:30,379 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:30,396 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1949455360_0019
2015-02-10 20:59:30,418 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1949455360/.staging/job_local1949455360_0019/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:30,418 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1949455360/.staging/job_local1949455360_0019/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:30,475 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1949455360_0019/job_local1949455360_0019.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:30,476 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1949455360_0019/job_local1949455360_0019.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:30,478 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:30,478 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:30,479 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:30,479 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1949455360_0019
2015-02-10 20:59:30,479 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:30,482 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:30,482 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1949455360_0019_m_000000_0
2015-02-10 20:59:30,484 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:30,485 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:30,485 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@70398f3c
2015-02-10 20:59:30,487 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:30,487 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:30,511 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:30,512 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:30,512 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:30,512 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:30,512 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:30,513 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:30,514 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:30,520 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:30,520 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:30,524 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:30,524 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:30,524 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:30,525 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:30,525 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:30,528 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:30,530 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1949455360_0019_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:30,531 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:30,532 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1949455360_0019_m_000000_0' done.
2015-02-10 20:59:30,532 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1949455360_0019_m_000000_0
2015-02-10 20:59:30,532 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:30,533 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:30,533 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1949455360_0019_r_000000_0
2015-02-10 20:59:30,534 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:30,535 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@46844c3d
2015-02-10 20:59:30,535 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:30,536 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1949455360_0019_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:30,538 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#19 about to shuffle output of map attempt_local1949455360_0019_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:30,538 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1949455360_0019_m_000000_0
2015-02-10 20:59:30,539 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:30,539 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:30,540 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:30,540 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:30,544 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:30,545 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:30,546 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:30,547 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:30,547 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:30,548 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:30,548 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:30,549 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:30,550 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:30,550 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:30,557 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:30,557 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_SWAP"]
2015-02-10 20:59:30,571 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1949455360_0019_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:30,573 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:30,573 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local1949455360_0019_r_000000_0 is allowed to commit now
2015-02-10 20:59:30,574 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1949455360_0019_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_SWAP/_temporary/0/task_local1949455360_0019_r_000000
2015-02-10 20:59:30,575 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:30,576 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1949455360_0019_r_000000_0' done.
2015-02-10 20:59:30,576 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1949455360_0019_r_000000_0
2015-02-10 20:59:30,576 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:30,601 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_SWAP/_temporary
2015-02-10 20:59:30,635 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:30,670 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:30,671 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/-1_ARGS_SWAP
2015-02-10 20:59:30,694 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:30,694 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:30,703 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:30,706 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:30,707 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:30,711 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:30,711 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:30,711 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_-1"]
2015-02-10 20:59:30,712 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:30,712 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:30,712 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:30,712 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...mblyplatform/0_'field'_-1
2015-02-10 20:59:30,713 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:30,715 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:30,739 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:30,759 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:30,779 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local447156619_0020
2015-02-10 20:59:30,801 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity447156619/.staging/job_local447156619_0020/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:30,801 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity447156619/.staging/job_local447156619_0020/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:30,861 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local447156619_0020/job_local447156619_0020.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:30,861 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local447156619_0020/job_local447156619_0020.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:30,863 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:30,863 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:30,864 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:30,863 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local447156619_0020
2015-02-10 20:59:30,864 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:30,866 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:30,866 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local447156619_0020_m_000000_0
2015-02-10 20:59:30,868 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:30,869 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:30,869 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@22ddcabb
2015-02-10 20:59:30,870 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:30,871 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:30,894 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:30,894 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:30,894 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:30,894 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:30,895 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:30,896 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:30,896 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:30,902 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:30,903 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:30,906 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:30,906 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:30,906 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:30,906 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:30,907 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:30,910 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:30,911 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local447156619_0020_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:30,913 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:30,913 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local447156619_0020_m_000000_0' done.
2015-02-10 20:59:30,914 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local447156619_0020_m_000000_0
2015-02-10 20:59:30,914 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:30,915 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:30,915 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local447156619_0020_r_000000_0
2015-02-10 20:59:30,917 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:30,917 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@1afdc98d
2015-02-10 20:59:30,918 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=508939456, maxSingleShuffleLimit=127234864, mergeThreshold=335900064, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:30,919 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local447156619_0020_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:30,921 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#20 about to shuffle output of map attempt_local447156619_0020_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:30,921 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local447156619_0020_m_000000_0
2015-02-10 20:59:30,922 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:30,922 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:30,924 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:30,924 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:30,927 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:30,928 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:30,930 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:30,930 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:30,931 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:30,931 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:30,931 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:30,932 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:30,932 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:30,932 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:30,939 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:30,939 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_-1"]
2015-02-10 20:59:30,952 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local447156619_0020_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:30,954 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:30,954 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local447156619_0020_r_000000_0 is allowed to commit now
2015-02-10 20:59:30,955 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local447156619_0020_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_-1/_temporary/0/task_local447156619_0020_r_000000
2015-02-10 20:59:30,956 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:30,956 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local447156619_0020_r_000000_0' done.
2015-02-10 20:59:30,956 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local447156619_0020_r_000000_0
2015-02-10 20:59:30,957 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:30,972 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_-1/_temporary
2015-02-10 20:59:31,003 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:31,038 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:31,039 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_'field'_-1
2015-02-10 20:59:31,060 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:31,061 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:31,068 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:31,071 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:31,071 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:31,076 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:31,076 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:31,076 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_'field'"]
2015-02-10 20:59:31,076 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:31,076 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:31,077 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:31,079 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...latform/0_'field'_'field'
2015-02-10 20:59:31,079 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:31,080 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:31,104 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:31,123 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:31,141 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1653969750_0021
2015-02-10 20:59:31,163 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1653969750/.staging/job_local1653969750_0021/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:31,163 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1653969750/.staging/job_local1653969750_0021/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:31,225 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1653969750_0021/job_local1653969750_0021.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:31,225 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1653969750_0021/job_local1653969750_0021.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:31,227 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:31,227 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1653969750_0021
2015-02-10 20:59:31,227 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:31,227 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:31,228 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:31,231 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:31,231 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1653969750_0021_m_000000_0
2015-02-10 20:59:31,233 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:31,235 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:31,235 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@264b898
2015-02-10 20:59:31,236 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:31,236 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:31,268 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:31,268 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:31,268 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:31,268 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:31,269 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:31,270 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:31,270 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:31,276 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:31,277 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:31,281 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:31,281 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:31,281 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:31,281 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:31,281 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:31,284 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:31,286 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1653969750_0021_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:31,288 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:31,288 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1653969750_0021_m_000000_0' done.
2015-02-10 20:59:31,289 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1653969750_0021_m_000000_0
2015-02-10 20:59:31,289 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:31,289 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:31,290 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1653969750_0021_r_000000_0
2015-02-10 20:59:31,292 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:31,292 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@3f4c428f
2015-02-10 20:59:31,293 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=510728608, maxSingleShuffleLimit=127682152, mergeThreshold=337080896, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:31,294 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1653969750_0021_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:31,296 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#21 about to shuffle output of map attempt_local1653969750_0021_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:31,296 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1653969750_0021_m_000000_0
2015-02-10 20:59:31,296 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:31,297 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:31,298 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:31,300 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:31,302 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:31,303 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:31,304 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:31,305 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:31,305 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:31,306 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:31,306 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:31,307 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:31,308 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:31,308 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:31,314 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:31,314 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_'field'"]
2015-02-10 20:59:31,327 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1653969750_0021_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:31,329 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:31,329 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local1653969750_0021_r_000000_0 is allowed to commit now
2015-02-10 20:59:31,330 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1653969750_0021_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_'field'/_temporary/0/task_local1653969750_0021_r_000000
2015-02-10 20:59:31,331 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:31,331 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1653969750_0021_r_000000_0' done.
2015-02-10 20:59:31,332 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1653969750_0021_r_000000_0
2015-02-10 20:59:31,332 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:31,355 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_'field'/_temporary
2015-02-10 20:59:31,385 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:31,418 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:31,420 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_'field'_'field'
2015-02-10 20:59:31,436 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:31,437 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:31,444 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:31,445 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:31,446 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:31,450 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:31,450 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:31,450 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_RESULTS"]
2015-02-10 20:59:31,451 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:31,451 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:31,451 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:31,452 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...latform/0_'field'_RESULTS
2015-02-10 20:59:31,453 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:31,454 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:31,478 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:31,497 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:31,513 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local296655755_0022
2015-02-10 20:59:31,534 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity296655755/.staging/job_local296655755_0022/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:31,534 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity296655755/.staging/job_local296655755_0022/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:31,592 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local296655755_0022/job_local296655755_0022.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:31,593 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local296655755_0022/job_local296655755_0022.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:31,594 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:31,595 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local296655755_0022
2015-02-10 20:59:31,595 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:31,595 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:31,595 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:31,714 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:31,714 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local296655755_0022_m_000000_0
2015-02-10 20:59:31,716 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:31,717 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:31,718 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@1a3580ab
2015-02-10 20:59:31,719 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:31,719 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:31,748 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:31,749 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:31,749 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:31,749 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:31,749 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:31,750 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:31,751 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:31,757 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:31,758 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:31,762 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:31,762 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:31,762 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:31,762 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:31,762 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:31,765 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:31,767 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local296655755_0022_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:31,769 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:31,770 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local296655755_0022_m_000000_0' done.
2015-02-10 20:59:31,770 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local296655755_0022_m_000000_0
2015-02-10 20:59:31,770 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:31,770 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:31,771 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local296655755_0022_r_000000_0
2015-02-10 20:59:31,772 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:31,772 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@170fbe75
2015-02-10 20:59:31,773 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=546832384, maxSingleShuffleLimit=136708096, mergeThreshold=360909376, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:31,774 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local296655755_0022_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:31,775 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#22 about to shuffle output of map attempt_local296655755_0022_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:31,776 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local296655755_0022_m_000000_0
2015-02-10 20:59:31,776 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:31,777 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:31,778 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:31,778 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:31,781 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:31,781 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:31,784 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:31,784 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:31,784 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:31,784 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:31,785 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:31,786 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:31,786 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:31,786 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:31,792 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:31,792 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_RESULTS"]
2015-02-10 20:59:31,805 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local296655755_0022_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:31,806 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:31,806 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local296655755_0022_r_000000_0 is allowed to commit now
2015-02-10 20:59:31,807 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local296655755_0022_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_RESULTS/_temporary/0/task_local296655755_0022_r_000000
2015-02-10 20:59:31,808 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:31,808 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local296655755_0022_r_000000_0' done.
2015-02-10 20:59:31,809 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local296655755_0022_r_000000_0
2015-02-10 20:59:31,809 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:31,825 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_RESULTS/_temporary
2015-02-10 20:59:31,850 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:31,856 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:31,885 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:31,887 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_'field'_RESULTS
2015-02-10 20:59:31,905 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:31,906 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:31,913 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:31,915 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:31,916 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:31,921 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:31,921 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:31,921 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_ALL"]
2015-02-10 20:59:31,921 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:31,921 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:31,921 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:31,922 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...blyplatform/0_'field'_ALL
2015-02-10 20:59:31,923 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:31,924 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:31,947 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:31,965 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:31,982 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local78520465_0023
2015-02-10 20:59:32,000 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity78520465/.staging/job_local78520465_0023/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:32,000 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity78520465/.staging/job_local78520465_0023/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:32,048 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local78520465_0023/job_local78520465_0023.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:32,048 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local78520465_0023/job_local78520465_0023.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:32,049 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:32,050 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local78520465_0023
2015-02-10 20:59:32,050 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:32,050 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:32,050 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:32,053 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:32,053 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local78520465_0023_m_000000_0
2015-02-10 20:59:32,055 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:32,056 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:32,057 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@2a51b326
2015-02-10 20:59:32,058 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:32,058 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:32,087 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:32,088 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:32,088 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:32,088 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:32,089 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:32,090 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:32,090 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:32,096 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:32,097 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:32,100 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:32,101 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:32,101 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:32,101 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:32,102 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:32,105 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:32,107 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local78520465_0023_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:32,109 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:32,109 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local78520465_0023_m_000000_0' done.
2015-02-10 20:59:32,109 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local78520465_0023_m_000000_0
2015-02-10 20:59:32,110 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:32,110 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:32,111 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local78520465_0023_r_000000_0
2015-02-10 20:59:32,112 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:32,113 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@69dc7a0d
2015-02-10 20:59:32,113 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=549309632, maxSingleShuffleLimit=137327408, mergeThreshold=362544384, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:32,114 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local78520465_0023_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:32,116 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#23 about to shuffle output of map attempt_local78520465_0023_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:32,117 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local78520465_0023_m_000000_0
2015-02-10 20:59:32,117 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:32,118 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:32,120 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:32,120 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:32,122 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:32,122 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:32,124 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:32,124 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:32,125 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:32,125 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:32,126 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:32,127 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:32,127 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:32,127 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:32,133 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:32,134 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_ALL"]
2015-02-10 20:59:32,148 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local78520465_0023_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:32,149 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:32,149 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local78520465_0023_r_000000_0 is allowed to commit now
2015-02-10 20:59:32,150 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local78520465_0023_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_ALL/_temporary/0/task_local78520465_0023_r_000000
2015-02-10 20:59:32,152 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:32,152 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local78520465_0023_r_000000_0' done.
2015-02-10 20:59:32,152 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local78520465_0023_r_000000_0
2015-02-10 20:59:32,152 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:32,175 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_ALL/_temporary
2015-02-10 20:59:32,205 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:32,237 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:32,239 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_'field'_ALL
2015-02-10 20:59:32,257 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:32,258 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:32,263 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_'field'_REPLACE
2015-02-10 20:59:32,280 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:32,281 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:32,287 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:32,290 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:32,291 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:32,295 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:32,295 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:32,295 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_SWAP"]
2015-02-10 20:59:32,295 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:32,295 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:32,296 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:32,296 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...lyplatform/0_'field'_SWAP
2015-02-10 20:59:32,297 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:32,298 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:32,322 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:32,340 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:32,355 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local2137655569_0024
2015-02-10 20:59:32,372 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity2137655569/.staging/job_local2137655569_0024/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:32,372 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity2137655569/.staging/job_local2137655569_0024/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:32,418 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2137655569_0024/job_local2137655569_0024.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:32,418 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local2137655569_0024/job_local2137655569_0024.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:32,420 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:32,420 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local2137655569_0024
2015-02-10 20:59:32,420 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:32,420 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:32,420 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:32,423 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:32,423 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local2137655569_0024_m_000000_0
2015-02-10 20:59:32,425 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:32,426 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:32,426 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@17894800
2015-02-10 20:59:32,428 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:32,428 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:32,457 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:32,457 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:32,457 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:32,457 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:32,457 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:32,459 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:32,459 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:32,467 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:32,467 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:32,471 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:32,471 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:32,471 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:32,471 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:32,471 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:32,475 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:32,476 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local2137655569_0024_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:32,478 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:32,478 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local2137655569_0024_m_000000_0' done.
2015-02-10 20:59:32,479 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local2137655569_0024_m_000000_0
2015-02-10 20:59:32,479 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:32,480 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:32,480 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local2137655569_0024_r_000000_0
2015-02-10 20:59:32,481 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:32,482 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@329e2e50
2015-02-10 20:59:32,482 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=551786880, maxSingleShuffleLimit=137946720, mergeThreshold=364179360, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:32,483 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local2137655569_0024_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:32,485 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#24 about to shuffle output of map attempt_local2137655569_0024_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:32,485 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local2137655569_0024_m_000000_0
2015-02-10 20:59:32,485 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:32,486 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:32,488 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:32,488 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:32,490 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:32,491 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:32,492 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:32,492 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:32,493 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:32,493 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:32,493 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:32,494 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:32,494 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:32,494 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:32,500 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:32,500 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_SWAP"]
2015-02-10 20:59:32,512 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local2137655569_0024_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:32,514 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:32,514 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local2137655569_0024_r_000000_0 is allowed to commit now
2015-02-10 20:59:32,514 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local2137655569_0024_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_SWAP/_temporary/0/task_local2137655569_0024_r_000000
2015-02-10 20:59:32,516 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:32,516 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local2137655569_0024_r_000000_0' done.
2015-02-10 20:59:32,516 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local2137655569_0024_r_000000_0
2015-02-10 20:59:32,516 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:32,533 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_'field'_SWAP/_temporary
2015-02-10 20:59:32,563 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:32,593 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:32,594 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_'field'_SWAP
2015-02-10 20:59:32,612 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:32,613 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:32,619 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:32,620 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:32,621 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:32,625 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:32,625 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:32,625 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_-1"]
2015-02-10 20:59:32,625 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:32,626 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:32,626 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:32,626 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...mblyplatform/0_UNKNOWN_-1
2015-02-10 20:59:32,627 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:32,628 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:32,652 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:32,670 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:32,684 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local284948507_0025
2015-02-10 20:59:32,701 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity284948507/.staging/job_local284948507_0025/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:32,701 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity284948507/.staging/job_local284948507_0025/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:32,745 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local284948507_0025/job_local284948507_0025.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:32,746 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local284948507_0025/job_local284948507_0025.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:32,747 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:32,747 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local284948507_0025
2015-02-10 20:59:32,747 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:32,747 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:32,747 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:32,750 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:32,750 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local284948507_0025_m_000000_0
2015-02-10 20:59:32,752 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:32,753 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:32,753 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@70038599
2015-02-10 20:59:32,755 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:32,755 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:32,783 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:32,784 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:32,784 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:32,784 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:32,784 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:32,785 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:32,785 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:32,791 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:32,791 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:32,795 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:32,795 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:32,795 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:32,795 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:32,795 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:32,799 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:32,800 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local284948507_0025_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:32,802 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:32,803 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local284948507_0025_m_000000_0' done.
2015-02-10 20:59:32,803 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local284948507_0025_m_000000_0
2015-02-10 20:59:32,803 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:32,803 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:32,804 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local284948507_0025_r_000000_0
2015-02-10 20:59:32,806 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:32,806 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@6d116cae
2015-02-10 20:59:32,806 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=551970368, maxSingleShuffleLimit=137992592, mergeThreshold=364300448, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:32,807 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local284948507_0025_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:32,809 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#25 about to shuffle output of map attempt_local284948507_0025_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:32,809 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local284948507_0025_m_000000_0
2015-02-10 20:59:32,810 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:32,810 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:32,811 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:32,812 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:32,817 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:32,817 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:32,819 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:32,820 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:32,820 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:32,821 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:32,821 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:32,822 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:32,823 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:32,823 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:32,830 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:32,830 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_-1"]
2015-02-10 20:59:32,843 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local284948507_0025_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:32,844 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:32,845 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local284948507_0025_r_000000_0 is allowed to commit now
2015-02-10 20:59:32,846 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local284948507_0025_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_-1/_temporary/0/task_local284948507_0025_r_000000
2015-02-10 20:59:32,847 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:32,847 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local284948507_0025_r_000000_0' done.
2015-02-10 20:59:32,848 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local284948507_0025_r_000000_0
2015-02-10 20:59:32,848 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:32,870 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_-1/_temporary
2015-02-10 20:59:32,898 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:32,932 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:32,933 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_-1
2015-02-10 20:59:32,949 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:32,949 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:32,954 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_'field'
2015-02-10 20:59:32,969 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:32,970 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:32,975 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:32,977 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:32,978 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:32,982 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:32,982 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:32,982 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_RESULTS"]
2015-02-10 20:59:32,982 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:32,982 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:32,982 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:32,984 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...latform/0_UNKNOWN_RESULTS
2015-02-10 20:59:32,985 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:32,987 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:33,010 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:33,028 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:33,043 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1247097328_0026
2015-02-10 20:59:33,054 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:33,061 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1247097328/.staging/job_local1247097328_0026/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:33,061 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1247097328/.staging/job_local1247097328_0026/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:33,106 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1247097328_0026/job_local1247097328_0026.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:33,107 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1247097328_0026/job_local1247097328_0026.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:33,108 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:33,108 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1247097328_0026
2015-02-10 20:59:33,108 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:33,108 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:33,109 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:33,111 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:33,112 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1247097328_0026_m_000000_0
2015-02-10 20:59:33,113 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:33,114 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:33,114 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@3c407d5
2015-02-10 20:59:33,115 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:33,116 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:33,144 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:33,144 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:33,144 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:33,145 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:33,145 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:33,146 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:33,146 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:33,152 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:33,152 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:33,155 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:33,155 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:33,156 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:33,156 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:33,156 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:33,159 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:33,160 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1247097328_0026_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:33,162 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:33,162 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1247097328_0026_m_000000_0' done.
2015-02-10 20:59:33,162 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1247097328_0026_m_000000_0
2015-02-10 20:59:33,163 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:33,163 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:33,163 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1247097328_0026_r_000000_0
2015-02-10 20:59:33,165 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:33,165 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@422b2fec
2015-02-10 20:59:33,166 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552016256, maxSingleShuffleLimit=138004064, mergeThreshold=364330752, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:33,167 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1247097328_0026_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:33,168 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#26 about to shuffle output of map attempt_local1247097328_0026_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:33,169 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1247097328_0026_m_000000_0
2015-02-10 20:59:33,169 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:33,170 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:33,171 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:33,171 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:33,173 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:33,173 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:33,175 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:33,175 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:33,175 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:33,176 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:33,176 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:33,177 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:33,178 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:33,178 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:33,184 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:33,185 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_RESULTS"]
2015-02-10 20:59:33,197 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1247097328_0026_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:33,199 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:33,199 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local1247097328_0026_r_000000_0 is allowed to commit now
2015-02-10 20:59:33,200 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1247097328_0026_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_RESULTS/_temporary/0/task_local1247097328_0026_r_000000
2015-02-10 20:59:33,201 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:33,202 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1247097328_0026_r_000000_0' done.
2015-02-10 20:59:33,202 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1247097328_0026_r_000000_0
2015-02-10 20:59:33,202 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:33,221 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_RESULTS/_temporary
2015-02-10 20:59:33,250 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:33,280 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:33,281 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_RESULTS
2015-02-10 20:59:33,297 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:33,297 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:33,303 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:33,304 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:33,305 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:33,308 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:33,309 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:33,309 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_ALL"]
2015-02-10 20:59:33,309 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:33,309 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:33,309 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:33,310 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...blyplatform/0_UNKNOWN_ALL
2015-02-10 20:59:33,310 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:33,311 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:33,334 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:33,352 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:33,366 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1674002121_0027
2015-02-10 20:59:33,383 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1674002121/.staging/job_local1674002121_0027/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:33,383 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1674002121/.staging/job_local1674002121_0027/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:33,428 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1674002121_0027/job_local1674002121_0027.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:33,428 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1674002121_0027/job_local1674002121_0027.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:33,429 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:33,429 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1674002121_0027
2015-02-10 20:59:33,430 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:33,430 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:33,430 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:33,433 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:33,433 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1674002121_0027_m_000000_0
2015-02-10 20:59:33,434 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:33,435 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:33,436 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@56dee1b4
2015-02-10 20:59:33,437 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:33,437 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:33,465 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:33,465 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:33,466 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:33,466 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:33,466 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:33,467 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:33,467 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:33,473 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:33,473 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:33,476 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:33,477 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:33,477 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:33,477 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:33,477 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:33,480 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:33,481 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1674002121_0027_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:33,483 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:33,483 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1674002121_0027_m_000000_0' done.
2015-02-10 20:59:33,484 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1674002121_0027_m_000000_0
2015-02-10 20:59:33,484 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:33,484 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:33,484 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1674002121_0027_r_000000_0
2015-02-10 20:59:33,486 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:33,486 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@1a0d7ed8
2015-02-10 20:59:33,487 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552153920, maxSingleShuffleLimit=138038480, mergeThreshold=364421600, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:33,488 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1674002121_0027_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:33,490 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#27 about to shuffle output of map attempt_local1674002121_0027_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:33,490 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1674002121_0027_m_000000_0
2015-02-10 20:59:33,490 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:33,491 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:33,492 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:33,492 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:33,494 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:33,495 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:33,495 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:33,496 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:33,497 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:33,497 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:33,498 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:33,498 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:33,499 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:33,499 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:33,500 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:33,505 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:33,506 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_ALL"]
2015-02-10 20:59:33,520 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1674002121_0027_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:33,521 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:33,522 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local1674002121_0027_r_000000_0 is allowed to commit now
2015-02-10 20:59:33,522 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1674002121_0027_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_ALL/_temporary/0/task_local1674002121_0027_r_000000
2015-02-10 20:59:33,524 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:33,524 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1674002121_0027_r_000000_0' done.
2015-02-10 20:59:33,524 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1674002121_0027_r_000000_0
2015-02-10 20:59:33,524 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:33,541 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_ALL/_temporary
2015-02-10 20:59:33,571 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:33,600 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:33,602 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_ALL
2015-02-10 20:59:33,617 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:33,618 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:33,623 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:33,625 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:33,626 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:33,630 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:33,630 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:33,630 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_REPLACE"]
2015-02-10 20:59:33,630 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:33,630 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:33,630 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:33,631 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...latform/0_UNKNOWN_REPLACE
2015-02-10 20:59:33,632 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:33,633 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:33,656 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:33,674 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:33,688 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1059149558_0028
2015-02-10 20:59:33,705 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1059149558/.staging/job_local1059149558_0028/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:33,705 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1059149558/.staging/job_local1059149558_0028/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:33,753 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1059149558_0028/job_local1059149558_0028.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:33,754 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1059149558_0028/job_local1059149558_0028.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:33,755 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:33,756 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1059149558_0028
2015-02-10 20:59:33,756 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:33,757 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:33,757 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:33,759 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:33,760 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1059149558_0028_m_000000_0
2015-02-10 20:59:33,761 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:33,762 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:33,763 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@7c2c0d3e
2015-02-10 20:59:33,764 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:33,764 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:33,793 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:33,794 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:33,794 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:33,794 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:33,794 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:33,795 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:33,798 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:33,804 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:33,804 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:33,808 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:33,809 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:33,809 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:33,809 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:33,809 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:33,812 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:33,814 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1059149558_0028_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:33,816 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:33,816 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1059149558_0028_m_000000_0' done.
2015-02-10 20:59:33,817 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1059149558_0028_m_000000_0
2015-02-10 20:59:33,817 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:33,818 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:33,818 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1059149558_0028_r_000000_0
2015-02-10 20:59:33,819 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:33,820 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@49fa7ba
2015-02-10 20:59:33,820 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552153920, maxSingleShuffleLimit=138038480, mergeThreshold=364421600, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:33,821 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1059149558_0028_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:33,825 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#28 about to shuffle output of map attempt_local1059149558_0028_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:33,826 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1059149558_0028_m_000000_0
2015-02-10 20:59:33,826 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:33,828 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:33,829 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:33,829 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:33,831 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:33,831 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:33,832 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:33,833 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:33,833 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:33,833 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:33,833 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:33,834 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:33,834 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:33,835 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:33,840 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:33,840 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_REPLACE"]
2015-02-10 20:59:33,848 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:33,849 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:33,851 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1059149558_0028
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:33,854 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local1059149558_0028 state at FAILED
2015-02-10 20:59:33,855 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 20:59:33,855 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 20:59:33,855 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 20:59:33,860 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 20:59:33,861 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...latform/0_UNKNOWN_REPLACE
2015-02-10 20:59:33,861 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 20:59:33,861 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_REPLACE/_temporary
2015-02-10 20:59:33,862 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_REPLACE
2015-02-10 20:59:33,878 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:33,878 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:33,879 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:33,884 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:33,886 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:33,887 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:33,890 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:33,891 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:33,891 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_SWAP"]
2015-02-10 20:59:33,891 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:33,891 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:33,891 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:33,893 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...lyplatform/0_UNKNOWN_SWAP
2015-02-10 20:59:33,893 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:33,895 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:33,918 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:33,936 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:33,951 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local412995492_0029
2015-02-10 20:59:33,967 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity412995492/.staging/job_local412995492_0029/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:33,967 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity412995492/.staging/job_local412995492_0029/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:34,012 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local412995492_0029/job_local412995492_0029.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:34,012 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local412995492_0029/job_local412995492_0029.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:34,013 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:34,013 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local412995492_0029
2015-02-10 20:59:34,013 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:34,014 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:34,014 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:34,016 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:34,017 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local412995492_0029_m_000000_0
2015-02-10 20:59:34,018 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:34,019 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:34,020 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@ed48578
2015-02-10 20:59:34,021 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:34,021 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:34,050 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:34,051 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:34,051 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:34,051 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:34,051 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:34,052 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:34,052 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:34,059 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:34,060 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:34,063 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:34,063 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:34,063 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:34,065 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:34,065 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:34,068 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:34,070 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local412995492_0029_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:34,071 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:34,071 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local412995492_0029_m_000000_0' done.
2015-02-10 20:59:34,072 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local412995492_0029_m_000000_0
2015-02-10 20:59:34,072 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:34,072 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:34,073 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local412995492_0029_r_000000_0
2015-02-10 20:59:34,074 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:34,074 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@28e1fbe3
2015-02-10 20:59:34,075 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552337408, maxSingleShuffleLimit=138084352, mergeThreshold=364542688, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:34,076 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local412995492_0029_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:34,077 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#29 about to shuffle output of map attempt_local412995492_0029_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:34,078 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local412995492_0029_m_000000_0
2015-02-10 20:59:34,078 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:34,079 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:34,081 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:34,082 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:34,083 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:34,083 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:34,085 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:34,085 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:34,085 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:34,085 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:34,086 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:34,086 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:34,087 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:34,087 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:34,092 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:34,092 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_SWAP"]
2015-02-10 20:59:34,104 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local412995492_0029_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:34,105 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:34,105 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local412995492_0029_r_000000_0 is allowed to commit now
2015-02-10 20:59:34,106 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local412995492_0029_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_SWAP/_temporary/0/task_local412995492_0029_r_000000
2015-02-10 20:59:34,107 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:34,107 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local412995492_0029_r_000000_0' done.
2015-02-10 20:59:34,108 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local412995492_0029_r_000000_0
2015-02-10 20:59:34,108 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:34,126 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_SWAP/_temporary
2015-02-10 20:59:34,155 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:34,185 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:34,187 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_UNKNOWN_SWAP
2015-02-10 20:59:34,204 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:34,205 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:34,211 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:34,213 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:34,213 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:34,217 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:34,217 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:34,218 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_-1"]
2015-02-10 20:59:34,218 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:34,218 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:34,218 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:34,219 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...emblyplatform/0_VALUES_-1
2015-02-10 20:59:34,219 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:34,221 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:34,246 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:34,263 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:34,278 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local259918524_0030
2015-02-10 20:59:34,281 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:34,295 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity259918524/.staging/job_local259918524_0030/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:34,295 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity259918524/.staging/job_local259918524_0030/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:34,341 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local259918524_0030/job_local259918524_0030.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:34,341 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local259918524_0030/job_local259918524_0030.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:34,342 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:34,343 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local259918524_0030
2015-02-10 20:59:34,343 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:34,343 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:34,344 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:34,347 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:34,347 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local259918524_0030_m_000000_0
2015-02-10 20:59:34,348 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:34,349 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:34,350 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@52ee271d
2015-02-10 20:59:34,351 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:34,351 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:34,380 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:34,380 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:34,380 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:34,380 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:34,381 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:34,382 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:34,382 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:34,388 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:34,388 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:34,391 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:34,391 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:34,391 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:34,392 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:34,392 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:34,394 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:34,396 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local259918524_0030_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:34,398 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:34,398 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local259918524_0030_m_000000_0' done.
2015-02-10 20:59:34,398 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local259918524_0030_m_000000_0
2015-02-10 20:59:34,398 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:34,399 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:34,399 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local259918524_0030_r_000000_0
2015-02-10 20:59:34,400 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:34,400 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@6015eb5a
2015-02-10 20:59:34,401 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552429120, maxSingleShuffleLimit=138107280, mergeThreshold=364603232, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:34,402 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local259918524_0030_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:34,403 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#30 about to shuffle output of map attempt_local259918524_0030_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:34,404 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local259918524_0030_m_000000_0
2015-02-10 20:59:34,404 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:34,405 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:34,406 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:34,406 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:34,408 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:34,408 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:34,409 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:34,410 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:34,410 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:34,410 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:34,410 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:34,414 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:34,414 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:34,414 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:34,419 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:34,420 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_-1"]
2015-02-10 20:59:34,428 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:34,428 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:34,430 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local259918524_0030
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:34,433 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local259918524_0030 state at FAILED
2015-02-10 20:59:34,433 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 20:59:34,433 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 20:59:34,433 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 20:59:34,438 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 20:59:34,438 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...emblyplatform/0_VALUES_-1
2015-02-10 20:59:34,439 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 20:59:34,440 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_-1/_temporary
2015-02-10 20:59:34,440 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_VALUES_-1
2015-02-10 20:59:34,456 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:34,457 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:34,461 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_VALUES_'field'
2015-02-10 20:59:34,477 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:34,477 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:34,482 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:34,484 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:34,485 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:34,488 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:34,489 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:34,489 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_RESULTS"]
2015-02-10 20:59:34,489 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:34,490 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:34,490 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:34,491 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...platform/0_VALUES_RESULTS
2015-02-10 20:59:34,491 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:34,492 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:34,516 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:34,534 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:34,549 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1546319171_0031
2015-02-10 20:59:34,566 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1546319171/.staging/job_local1546319171_0031/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:34,566 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1546319171/.staging/job_local1546319171_0031/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:34,611 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1546319171_0031/job_local1546319171_0031.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:34,611 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1546319171_0031/job_local1546319171_0031.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:34,613 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:34,613 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1546319171_0031
2015-02-10 20:59:34,613 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:34,613 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:34,614 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:34,616 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:34,616 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1546319171_0031_m_000000_0
2015-02-10 20:59:34,618 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:34,619 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:34,619 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@3936d1b4
2015-02-10 20:59:34,620 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:34,620 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:34,649 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:34,649 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:34,649 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:34,649 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:34,649 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:34,650 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:34,651 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:34,658 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:34,659 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:34,662 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:34,662 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:34,662 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:34,662 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:34,662 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:34,665 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:34,667 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1546319171_0031_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:34,668 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:34,669 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1546319171_0031_m_000000_0' done.
2015-02-10 20:59:34,669 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1546319171_0031_m_000000_0
2015-02-10 20:59:34,669 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:34,669 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:34,670 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1546319171_0031_r_000000_0
2015-02-10 20:59:34,671 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:34,671 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@5c49d589
2015-02-10 20:59:34,672 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552612672, maxSingleShuffleLimit=138153168, mergeThreshold=364724384, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:34,673 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1546319171_0031_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:34,674 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#31 about to shuffle output of map attempt_local1546319171_0031_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:34,675 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1546319171_0031_m_000000_0
2015-02-10 20:59:34,675 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:34,676 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:34,677 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:34,677 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:34,679 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:34,679 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:34,682 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:34,683 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:34,683 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:34,683 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:34,683 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:34,684 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:34,684 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:34,685 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:34,690 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:34,690 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_RESULTS"]
2015-02-10 20:59:34,698 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:34,699 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:34,701 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1546319171_0031
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:34,710 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local1546319171_0031 state at FAILED
2015-02-10 20:59:34,710 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 20:59:34,710 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 20:59:34,710 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 20:59:34,714 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 20:59:34,714 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...platform/0_VALUES_RESULTS
2015-02-10 20:59:34,715 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 20:59:34,715 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_RESULTS/_temporary
2015-02-10 20:59:34,715 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_VALUES_RESULTS
2015-02-10 20:59:34,731 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:34,732 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:34,737 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:34,739 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:34,739 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:34,743 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:34,743 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:34,743 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_ALL"]
2015-02-10 20:59:34,743 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:34,743 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:34,744 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:34,745 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...mblyplatform/0_VALUES_ALL
2015-02-10 20:59:34,746 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:34,748 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:34,772 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:34,783 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:34,790 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:34,804 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local260088328_0032
2015-02-10 20:59:34,823 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity260088328/.staging/job_local260088328_0032/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:34,823 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity260088328/.staging/job_local260088328_0032/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:34,870 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local260088328_0032/job_local260088328_0032.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:34,871 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local260088328_0032/job_local260088328_0032.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:34,872 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:34,873 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local260088328_0032
2015-02-10 20:59:34,873 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:34,873 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:34,874 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:34,877 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:34,877 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local260088328_0032_m_000000_0
2015-02-10 20:59:34,878 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:34,879 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:34,880 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@46d3d145
2015-02-10 20:59:34,881 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:34,881 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:34,910 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:34,910 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:34,910 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:34,910 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:34,911 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:34,912 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:34,912 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:34,917 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:34,917 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:34,920 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:34,920 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:34,920 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:34,920 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:34,921 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:34,923 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:34,925 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local260088328_0032_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:34,926 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:34,927 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local260088328_0032_m_000000_0' done.
2015-02-10 20:59:34,927 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local260088328_0032_m_000000_0
2015-02-10 20:59:34,927 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:34,928 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:34,928 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local260088328_0032_r_000000_0
2015-02-10 20:59:34,929 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:34,929 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@7479daf5
2015-02-10 20:59:34,930 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552612672, maxSingleShuffleLimit=138153168, mergeThreshold=364724384, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:34,931 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local260088328_0032_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:34,932 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#32 about to shuffle output of map attempt_local260088328_0032_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:34,933 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local260088328_0032_m_000000_0
2015-02-10 20:59:34,933 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:34,934 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:34,934 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:34,935 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:34,936 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:34,937 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:34,938 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:34,939 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:34,939 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:34,939 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:34,939 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:34,940 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:34,941 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:34,942 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:34,946 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:34,947 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_ALL"]
2015-02-10 20:59:34,955 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:34,956 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:34,958 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local260088328_0032
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:34,961 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local260088328_0032 state at FAILED
2015-02-10 20:59:34,962 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 20:59:34,962 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 20:59:34,962 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 20:59:34,965 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 20:59:34,966 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...mblyplatform/0_VALUES_ALL
2015-02-10 20:59:34,966 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 20:59:34,966 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] shutting down job executor
2015-02-10 20:59:34,967 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] shutdown complete
2015-02-10 20:59:34,967 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_ALL/_temporary
2015-02-10 20:59:34,967 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_VALUES_ALL
2015-02-10 20:59:34,983 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:34,984 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:34,989 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:34,991 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:34,991 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:34,995 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:34,995 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:34,995 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_REPLACE"]
2015-02-10 20:59:34,995 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:34,995 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:34,995 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:34,996 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...platform/0_VALUES_REPLACE
2015-02-10 20:59:34,997 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:34,998 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:35,020 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:35,038 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:35,052 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1705094244_0033
2015-02-10 20:59:35,069 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1705094244/.staging/job_local1705094244_0033/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:35,069 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1705094244/.staging/job_local1705094244_0033/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:35,114 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1705094244_0033/job_local1705094244_0033.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:35,114 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1705094244_0033/job_local1705094244_0033.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:35,115 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:35,116 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:35,116 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:35,116 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1705094244_0033
2015-02-10 20:59:35,117 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:35,119 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:35,119 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1705094244_0033_m_000000_0
2015-02-10 20:59:35,120 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:35,121 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:35,122 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@5fa6e5d5
2015-02-10 20:59:35,124 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:35,124 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:35,240 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:35,240 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:35,241 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:35,241 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:35,241 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:35,242 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:35,242 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:35,247 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:35,248 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:35,251 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:35,251 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:35,251 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:35,251 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:35,251 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:35,254 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:35,256 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1705094244_0033_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:35,269 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:35,269 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1705094244_0033_m_000000_0' done.
2015-02-10 20:59:35,269 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1705094244_0033_m_000000_0
2015-02-10 20:59:35,269 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:35,270 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:35,271 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1705094244_0033_r_000000_0
2015-02-10 20:59:35,272 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:35,272 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@5a62a404
2015-02-10 20:59:35,273 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552796160, maxSingleShuffleLimit=138199040, mergeThreshold=364845472, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:35,274 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1705094244_0033_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:35,275 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#33 about to shuffle output of map attempt_local1705094244_0033_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:35,276 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1705094244_0033_m_000000_0
2015-02-10 20:59:35,276 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:35,277 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:35,278 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:35,278 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:35,280 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:35,280 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:35,282 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:35,282 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:35,282 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:35,282 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:35,283 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:35,283 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:35,284 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:35,284 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:35,288 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:35,289 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_REPLACE"]
2015-02-10 20:59:35,297 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:35,297 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:35,299 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1705094244_0033
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:35,307 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local1705094244_0033 state at FAILED
2015-02-10 20:59:35,308 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 20:59:35,308 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 20:59:35,308 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 20:59:35,311 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 20:59:35,313 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...platform/0_VALUES_REPLACE
2015-02-10 20:59:35,313 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 20:59:35,313 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_REPLACE/_temporary
2015-02-10 20:59:35,314 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_VALUES_REPLACE
2015-02-10 20:59:35,330 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:35,330 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:35,335 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:35,337 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:35,337 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:35,341 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:35,341 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:35,341 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_SWAP"]
2015-02-10 20:59:35,341 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:35,341 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:35,341 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:35,343 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...blyplatform/0_VALUES_SWAP
2015-02-10 20:59:35,344 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:35,345 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:35,368 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:35,386 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:35,400 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local756711217_0034
2015-02-10 20:59:35,416 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity756711217/.staging/job_local756711217_0034/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:35,417 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity756711217/.staging/job_local756711217_0034/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:35,462 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local756711217_0034/job_local756711217_0034.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:35,463 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local756711217_0034/job_local756711217_0034.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:35,464 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:35,464 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local756711217_0034
2015-02-10 20:59:35,465 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:35,465 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:35,465 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:35,467 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:35,468 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local756711217_0034_m_000000_0
2015-02-10 20:59:35,469 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:35,470 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:35,470 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@5fa52ad1
2015-02-10 20:59:35,471 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:35,471 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:35,489 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:35,489 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:35,489 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:35,489 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:35,489 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:35,490 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:35,491 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:35,495 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:35,495 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:35,498 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:35,499 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:35,499 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:35,499 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:35,499 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:35,502 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:35,504 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local756711217_0034_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:35,506 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:35,506 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local756711217_0034_m_000000_0' done.
2015-02-10 20:59:35,506 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local756711217_0034_m_000000_0
2015-02-10 20:59:35,506 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:35,507 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:35,508 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local756711217_0034_r_000000_0
2015-02-10 20:59:35,512 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:35,512 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@1a3174f7
2015-02-10 20:59:35,512 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552796160, maxSingleShuffleLimit=138199040, mergeThreshold=364845472, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:35,513 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local756711217_0034_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:35,515 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#34 about to shuffle output of map attempt_local756711217_0034_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:35,515 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local756711217_0034_m_000000_0
2015-02-10 20:59:35,515 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:35,516 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:35,517 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:35,517 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:35,519 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:35,519 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:35,521 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:35,521 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:35,521 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:35,521 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:35,522 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:35,522 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:35,522 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:35,523 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:35,527 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:35,527 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_SWAP"]
2015-02-10 20:59:35,535 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:35,536 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:35,537 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local756711217_0034
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:35,547 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local756711217_0034 state at FAILED
2015-02-10 20:59:35,547 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 20:59:35,547 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 20:59:35,548 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 20:59:35,551 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 20:59:35,551 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...blyplatform/0_VALUES_SWAP
2015-02-10 20:59:35,552 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 20:59:35,552 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] shutting down job executor
2015-02-10 20:59:35,552 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] shutdown complete
2015-02-10 20:59:35,553 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_VALUES_SWAP/_temporary
2015-02-10 20:59:35,553 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_VALUES_SWAP
2015-02-10 20:59:35,569 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:35,569 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:35,574 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:35,576 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:35,576 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:35,580 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:35,580 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:35,580 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_-1"]
2015-02-10 20:59:35,580 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:35,580 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:35,581 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:35,583 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...ssemblyplatform/0_ARGS_-1
2015-02-10 20:59:35,583 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:35,584 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:35,607 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:35,625 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:35,639 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1537999417_0035
2015-02-10 20:59:35,655 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1537999417/.staging/job_local1537999417_0035/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:35,655 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1537999417/.staging/job_local1537999417_0035/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:35,699 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1537999417_0035/job_local1537999417_0035.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:35,699 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1537999417_0035/job_local1537999417_0035.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:35,700 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:35,700 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1537999417_0035
2015-02-10 20:59:35,701 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:35,701 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:35,701 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:35,704 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:35,704 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1537999417_0035_m_000000_0
2015-02-10 20:59:35,705 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:35,707 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:35,707 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@6ea4ffc6
2015-02-10 20:59:35,708 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:35,708 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:35,736 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:35,737 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:35,737 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:35,737 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:35,737 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:35,738 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:35,738 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:35,743 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:35,743 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:35,746 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:35,746 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:35,747 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:35,747 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:35,747 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:35,750 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:35,751 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1537999417_0035_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:35,753 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:35,753 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1537999417_0035_m_000000_0' done.
2015-02-10 20:59:35,753 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1537999417_0035_m_000000_0
2015-02-10 20:59:35,753 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:35,754 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:35,754 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1537999417_0035_r_000000_0
2015-02-10 20:59:35,756 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:35,756 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@36577c06
2015-02-10 20:59:35,756 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552842048, maxSingleShuffleLimit=138210512, mergeThreshold=364875776, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:35,757 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1537999417_0035_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:35,759 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#35 about to shuffle output of map attempt_local1537999417_0035_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:35,759 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1537999417_0035_m_000000_0
2015-02-10 20:59:35,759 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:35,760 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:35,761 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:35,761 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:35,763 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:35,763 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:35,764 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:35,765 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:35,765 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:35,765 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:35,765 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:35,766 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:35,766 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:35,766 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:35,771 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:35,771 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_-1"]
2015-02-10 20:59:35,782 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1537999417_0035_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:35,783 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:35,783 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local1537999417_0035_r_000000_0 is allowed to commit now
2015-02-10 20:59:35,784 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1537999417_0035_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_-1/_temporary/0/task_local1537999417_0035_r_000000
2015-02-10 20:59:35,785 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:35,785 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1537999417_0035_r_000000_0' done.
2015-02-10 20:59:35,785 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1537999417_0035_r_000000_0
2015-02-10 20:59:35,786 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:35,801 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_-1/_temporary
2015-02-10 20:59:35,830 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:35,861 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:35,862 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_ARGS_-1
2015-02-10 20:59:35,878 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:35,878 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:35,882 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_ARGS_'field'
2015-02-10 20:59:35,898 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:35,898 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:35,904 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:35,906 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:35,907 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:35,910 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:35,910 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:35,910 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_RESULTS"]
2015-02-10 20:59:35,911 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:35,911 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:35,911 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:35,911 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...lyplatform/0_ARGS_RESULTS
2015-02-10 20:59:35,912 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:35,913 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:35,936 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:35,953 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:35,968 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1879264803_0036
2015-02-10 20:59:35,984 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1879264803/.staging/job_local1879264803_0036/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:35,984 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1879264803/.staging/job_local1879264803_0036/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:36,028 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1879264803_0036/job_local1879264803_0036.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:36,029 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1879264803_0036/job_local1879264803_0036.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:36,030 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:36,031 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:36,031 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:36,031 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1879264803_0036
2015-02-10 20:59:36,031 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:36,033 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:36,033 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1879264803_0036_m_000000_0
2015-02-10 20:59:36,035 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:36,036 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:36,036 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@64b28abf
2015-02-10 20:59:36,037 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:36,037 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:36,066 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:36,066 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:36,066 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:36,066 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:36,066 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:36,067 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:36,068 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:36,072 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:36,072 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:36,075 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:36,076 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:36,076 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:36,076 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:36,076 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:36,079 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:36,080 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1879264803_0036_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:36,082 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:36,082 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1879264803_0036_m_000000_0' done.
2015-02-10 20:59:36,082 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1879264803_0036_m_000000_0
2015-02-10 20:59:36,083 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:36,083 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:36,083 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1879264803_0036_r_000000_0
2015-02-10 20:59:36,085 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:36,085 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@14beb6
2015-02-10 20:59:36,086 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552979648, maxSingleShuffleLimit=138244912, mergeThreshold=364966592, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:36,086 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1879264803_0036_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:36,088 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#36 about to shuffle output of map attempt_local1879264803_0036_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:36,088 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1879264803_0036_m_000000_0
2015-02-10 20:59:36,088 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:36,089 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:36,090 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:36,090 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:36,092 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:36,092 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:36,094 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:36,094 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:36,094 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:36,094 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:36,095 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:36,095 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:36,095 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:36,096 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:36,100 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:36,100 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_RESULTS"]
2015-02-10 20:59:36,111 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1879264803_0036_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:36,113 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:36,113 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local1879264803_0036_r_000000_0 is allowed to commit now
2015-02-10 20:59:36,113 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1879264803_0036_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_RESULTS/_temporary/0/task_local1879264803_0036_r_000000
2015-02-10 20:59:36,114 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:36,115 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1879264803_0036_r_000000_0' done.
2015-02-10 20:59:36,115 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1879264803_0036_r_000000_0
2015-02-10 20:59:36,115 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:36,131 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_RESULTS/_temporary
2015-02-10 20:59:36,160 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:36,190 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:36,191 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_ARGS_RESULTS
2015-02-10 20:59:36,208 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:36,209 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:36,213 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_ARGS_ALL
2015-02-10 20:59:36,229 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:36,230 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:36,237 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:36,239 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:36,239 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:36,243 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:36,243 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:36,243 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_REPLACE"]
2015-02-10 20:59:36,244 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:36,244 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:36,244 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:36,244 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...lyplatform/0_ARGS_REPLACE
2015-02-10 20:59:36,245 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:36,246 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:36,269 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:36,287 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:36,301 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1339005569_0037
2015-02-10 20:59:36,318 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1339005569/.staging/job_local1339005569_0037/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:36,318 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1339005569/.staging/job_local1339005569_0037/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:36,363 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1339005569_0037/job_local1339005569_0037.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:36,363 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1339005569_0037/job_local1339005569_0037.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:36,365 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:36,365 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:36,366 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:36,365 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1339005569_0037
2015-02-10 20:59:36,367 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:36,369 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:36,370 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1339005569_0037_m_000000_0
2015-02-10 20:59:36,371 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:36,372 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:36,372 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@726b37ad
2015-02-10 20:59:36,373 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:36,374 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:36,402 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:36,402 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:36,402 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:36,402 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:36,402 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:36,404 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:36,404 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:36,409 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:36,409 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:36,412 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:36,413 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:36,413 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:36,413 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:36,413 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:36,416 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:36,418 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1339005569_0037_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:36,420 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:36,420 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1339005569_0037_m_000000_0' done.
2015-02-10 20:59:36,420 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1339005569_0037_m_000000_0
2015-02-10 20:59:36,421 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:36,421 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:36,421 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1339005569_0037_r_000000_0
2015-02-10 20:59:36,423 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:36,423 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@20197522
2015-02-10 20:59:36,424 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=552979648, maxSingleShuffleLimit=138244912, mergeThreshold=364966592, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:36,425 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1339005569_0037_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:36,426 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#37 about to shuffle output of map attempt_local1339005569_0037_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:36,427 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1339005569_0037_m_000000_0
2015-02-10 20:59:36,427 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:36,428 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:36,429 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:36,429 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:36,431 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:36,431 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:36,433 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:36,433 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:36,434 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:36,434 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:36,434 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:36,435 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:36,436 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:36,436 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:36,440 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:36,441 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_REPLACE"]
2015-02-10 20:59:36,452 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1339005569_0037_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:36,453 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:36,454 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local1339005569_0037_r_000000_0 is allowed to commit now
2015-02-10 20:59:36,454 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1339005569_0037_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_REPLACE/_temporary/0/task_local1339005569_0037_r_000000
2015-02-10 20:59:36,456 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:36,456 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1339005569_0037_r_000000_0' done.
2015-02-10 20:59:36,456 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1339005569_0037_r_000000_0
2015-02-10 20:59:36,457 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:36,477 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_REPLACE/_temporary
2015-02-10 20:59:36,506 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:36,537 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:36,538 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_ARGS_REPLACE
2015-02-10 20:59:36,554 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:36,554 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:36,559 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:36,560 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:36,561 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:36,564 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:36,564 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:36,565 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_SWAP"]
2015-02-10 20:59:36,565 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:36,565 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:36,565 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:36,566 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...emblyplatform/0_ARGS_SWAP
2015-02-10 20:59:36,566 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:36,568 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:36,591 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:36,683 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:36,698 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1760156238_0038
2015-02-10 20:59:36,714 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1760156238/.staging/job_local1760156238_0038/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:36,715 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1760156238/.staging/job_local1760156238_0038/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:36,968 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1760156238_0038/job_local1760156238_0038.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:36,968 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1760156238_0038/job_local1760156238_0038.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:36,969 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:36,969 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1760156238_0038
2015-02-10 20:59:36,970 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:36,970 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:36,971 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:36,973 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:36,974 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1760156238_0038_m_000000_0
2015-02-10 20:59:36,975 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:36,976 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:36,976 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@231aaee1
2015-02-10 20:59:36,977 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:36,978 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:37,006 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:37,006 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:37,006 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:37,006 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:37,007 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:37,008 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:37,008 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:37,013 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:37,013 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:37,016 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:37,016 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:37,016 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:37,016 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:37,016 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:37,019 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:37,021 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1760156238_0038_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:37,022 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:37,023 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1760156238_0038_m_000000_0' done.
2015-02-10 20:59:37,023 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1760156238_0038_m_000000_0
2015-02-10 20:59:37,023 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:37,023 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:37,024 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1760156238_0038_r_000000_0
2015-02-10 20:59:37,025 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:37,025 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@7f2bad63
2015-02-10 20:59:37,026 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=553117248, maxSingleShuffleLimit=138279312, mergeThreshold=365057408, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:37,027 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1760156238_0038_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:37,028 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#38 about to shuffle output of map attempt_local1760156238_0038_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:37,029 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1760156238_0038_m_000000_0
2015-02-10 20:59:37,029 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:37,030 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:37,030 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:37,030 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:37,033 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:37,033 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:37,035 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:37,035 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:37,035 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:37,035 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:37,036 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:37,036 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:37,037 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:37,037 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:37,041 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:37,042 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_SWAP"]
2015-02-10 20:59:37,053 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1760156238_0038_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:37,054 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:37,054 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local1760156238_0038_r_000000_0 is allowed to commit now
2015-02-10 20:59:37,055 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1760156238_0038_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_SWAP/_temporary/0/task_local1760156238_0038_r_000000
2015-02-10 20:59:37,056 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:37,056 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1760156238_0038_r_000000_0' done.
2015-02-10 20:59:37,056 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1760156238_0038_r_000000_0
2015-02-10 20:59:37,057 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:37,071 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/0_ARGS_SWAP/_temporary
2015-02-10 20:59:37,100 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:37,131 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:37,132 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/0_ARGS_SWAP
2015-02-10 20:59:37,150 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:37,150 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:37,155 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:37,157 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:37,157 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:37,161 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:37,161 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:37,161 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_-1"]
2015-02-10 20:59:37,161 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:37,162 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:37,162 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:37,162 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...lyplatform/ALL_'field'_-1
2015-02-10 20:59:37,163 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:37,164 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:37,187 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:37,205 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:37,219 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local108528858_0039
2015-02-10 20:59:37,235 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity108528858/.staging/job_local108528858_0039/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:37,236 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity108528858/.staging/job_local108528858_0039/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:37,280 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local108528858_0039/job_local108528858_0039.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:37,280 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local108528858_0039/job_local108528858_0039.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:37,281 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:37,281 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local108528858_0039
2015-02-10 20:59:37,281 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:37,281 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:37,282 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:37,285 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:37,285 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local108528858_0039_m_000000_0
2015-02-10 20:59:37,287 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:37,289 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:37,289 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@486ab98
2015-02-10 20:59:37,290 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:37,291 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:37,320 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:37,321 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:37,321 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:37,321 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:37,321 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:37,323 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:37,323 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:37,328 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:37,329 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:37,332 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:37,332 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:37,332 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:37,332 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:37,332 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:37,335 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:37,337 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local108528858_0039_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:37,338 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:37,339 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local108528858_0039_m_000000_0' done.
2015-02-10 20:59:37,339 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local108528858_0039_m_000000_0
2015-02-10 20:59:37,339 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:37,339 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:37,340 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local108528858_0039_r_000000_0
2015-02-10 20:59:37,342 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:37,342 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@53354a57
2015-02-10 20:59:37,343 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=553209024, maxSingleShuffleLimit=138302256, mergeThreshold=365117984, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:37,343 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local108528858_0039_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:37,345 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#39 about to shuffle output of map attempt_local108528858_0039_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:37,345 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local108528858_0039_m_000000_0
2015-02-10 20:59:37,346 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:37,346 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:37,348 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:37,348 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:37,353 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:37,353 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:37,355 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:37,355 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:37,355 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:37,356 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:37,356 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:37,356 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:37,357 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:37,357 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:37,361 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:37,362 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_-1"]
2015-02-10 20:59:37,373 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local108528858_0039_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:37,374 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:37,374 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local108528858_0039_r_000000_0 is allowed to commit now
2015-02-10 20:59:37,375 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local108528858_0039_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_-1/_temporary/0/task_local108528858_0039_r_000000
2015-02-10 20:59:37,376 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:37,376 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local108528858_0039_r_000000_0' done.
2015-02-10 20:59:37,376 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local108528858_0039_r_000000_0
2015-02-10 20:59:37,376 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:37,396 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_-1/_temporary
2015-02-10 20:59:37,424 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:37,453 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:37,455 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_-1
2015-02-10 20:59:37,471 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:37,472 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:37,477 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:37,478 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:37,479 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:37,482 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:37,483 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:37,483 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_'field'"]
2015-02-10 20:59:37,483 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:37,483 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:37,483 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:37,484 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...tform/ALL_'field'_'field'
2015-02-10 20:59:37,484 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:37,485 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:37,508 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:37,526 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:37,541 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1869523739_0040
2015-02-10 20:59:37,559 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1869523739/.staging/job_local1869523739_0040/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:37,559 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1869523739/.staging/job_local1869523739_0040/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:37,606 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1869523739_0040/job_local1869523739_0040.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:37,607 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1869523739_0040/job_local1869523739_0040.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:37,608 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:37,608 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1869523739_0040
2015-02-10 20:59:37,609 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:37,609 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:37,610 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:37,613 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:37,613 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1869523739_0040_m_000000_0
2015-02-10 20:59:37,614 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:37,616 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:37,616 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@4b935405
2015-02-10 20:59:37,617 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:37,617 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:37,646 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:37,646 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:37,646 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:37,646 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:37,646 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:37,648 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:37,648 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:37,652 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:37,652 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:37,655 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:37,655 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:37,655 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:37,656 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:37,656 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:37,658 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:37,660 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1869523739_0040_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:37,662 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:37,662 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1869523739_0040_m_000000_0' done.
2015-02-10 20:59:37,662 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1869523739_0040_m_000000_0
2015-02-10 20:59:37,662 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:37,663 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:37,663 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1869523739_0040_r_000000_0
2015-02-10 20:59:37,664 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:37,665 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@681564f4
2015-02-10 20:59:37,665 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=553300800, maxSingleShuffleLimit=138325200, mergeThreshold=365178528, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:37,666 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1869523739_0040_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:37,668 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#40 about to shuffle output of map attempt_local1869523739_0040_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:37,668 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1869523739_0040_m_000000_0
2015-02-10 20:59:37,668 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:37,669 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:37,669 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:37,670 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:37,671 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:37,671 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:37,673 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:37,673 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:37,673 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:37,674 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:37,674 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:37,674 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:37,675 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:37,675 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:37,679 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:37,679 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_'field'"]
2015-02-10 20:59:37,690 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1869523739_0040_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:37,692 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:37,692 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local1869523739_0040_r_000000_0 is allowed to commit now
2015-02-10 20:59:37,692 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1869523739_0040_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_'field'/_temporary/0/task_local1869523739_0040_r_000000
2015-02-10 20:59:37,693 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:37,694 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1869523739_0040_r_000000_0' done.
2015-02-10 20:59:37,694 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1869523739_0040_r_000000_0
2015-02-10 20:59:37,694 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:37,711 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_'field'/_temporary
2015-02-10 20:59:37,740 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:37,769 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:37,770 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_'field'
2015-02-10 20:59:37,786 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:37,786 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:37,791 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:37,793 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:37,793 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:37,796 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:37,796 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:37,796 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_RESULTS"]
2015-02-10 20:59:37,797 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:37,797 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:37,797 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:37,798 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...tform/ALL_'field'_RESULTS
2015-02-10 20:59:37,798 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:37,799 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:37,823 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:37,841 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:37,856 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local746255553_0041
2015-02-10 20:59:37,873 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity746255553/.staging/job_local746255553_0041/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:37,873 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity746255553/.staging/job_local746255553_0041/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:37,920 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local746255553_0041/job_local746255553_0041.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:37,920 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local746255553_0041/job_local746255553_0041.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:37,923 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:37,923 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local746255553_0041
2015-02-10 20:59:37,923 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:37,923 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:37,923 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:37,925 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:37,925 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local746255553_0041_m_000000_0
2015-02-10 20:59:37,927 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:37,928 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:37,928 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@f7fb9e0
2015-02-10 20:59:37,929 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:37,929 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:37,957 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:37,957 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:37,957 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:37,958 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:37,958 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:37,959 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:37,959 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:37,964 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:37,964 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:37,967 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:37,967 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:37,967 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:37,967 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:37,967 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:37,970 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:37,972 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local746255553_0041_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:37,974 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:37,974 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local746255553_0041_m_000000_0' done.
2015-02-10 20:59:37,974 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local746255553_0041_m_000000_0
2015-02-10 20:59:37,974 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:37,975 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:37,975 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local746255553_0041_r_000000_0
2015-02-10 20:59:37,976 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:37,976 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@7047da9b
2015-02-10 20:59:37,977 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=553300800, maxSingleShuffleLimit=138325200, mergeThreshold=365178528, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:37,978 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local746255553_0041_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:37,979 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#41 about to shuffle output of map attempt_local746255553_0041_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:37,979 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local746255553_0041_m_000000_0
2015-02-10 20:59:37,979 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:37,980 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:37,980 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:37,980 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:37,982 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:37,982 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:37,983 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:37,984 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:37,984 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:37,984 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:37,984 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:37,985 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:37,985 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:37,985 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:37,989 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:37,990 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_RESULTS"]
2015-02-10 20:59:38,001 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local746255553_0041_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:38,002 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:38,002 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local746255553_0041_r_000000_0 is allowed to commit now
2015-02-10 20:59:38,003 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local746255553_0041_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_RESULTS/_temporary/0/task_local746255553_0041_r_000000
2015-02-10 20:59:38,004 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:38,004 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local746255553_0041_r_000000_0' done.
2015-02-10 20:59:38,004 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local746255553_0041_r_000000_0
2015-02-10 20:59:38,004 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:38,022 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_RESULTS/_temporary
2015-02-10 20:59:38,050 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:38,079 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:38,081 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_RESULTS
2015-02-10 20:59:38,097 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:38,097 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:38,103 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:38,105 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:38,105 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:38,108 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:38,109 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:38,109 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_ALL"]
2015-02-10 20:59:38,109 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:38,110 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:38,110 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:38,111 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...yplatform/ALL_'field'_ALL
2015-02-10 20:59:38,111 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:38,112 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:38,135 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:38,153 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:38,168 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local835480914_0042
2015-02-10 20:59:38,186 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity835480914/.staging/job_local835480914_0042/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:38,186 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity835480914/.staging/job_local835480914_0042/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:38,232 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local835480914_0042/job_local835480914_0042.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:38,233 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local835480914_0042/job_local835480914_0042.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:38,234 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:38,234 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:38,235 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:38,234 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local835480914_0042
2015-02-10 20:59:38,235 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:38,236 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:38,237 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local835480914_0042_m_000000_0
2015-02-10 20:59:38,238 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:38,239 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:38,240 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@5db533b0
2015-02-10 20:59:38,241 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:38,241 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:38,271 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:38,271 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:38,271 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:38,271 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:38,271 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:38,273 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:38,273 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:38,278 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:38,278 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:38,281 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:38,282 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:38,282 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:38,282 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:38,282 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:38,286 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:38,287 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local835480914_0042_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:38,289 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:38,290 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local835480914_0042_m_000000_0' done.
2015-02-10 20:59:38,290 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local835480914_0042_m_000000_0
2015-02-10 20:59:38,290 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:38,291 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:38,291 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local835480914_0042_r_000000_0
2015-02-10 20:59:38,293 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:38,293 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@4e345c87
2015-02-10 20:59:38,294 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=553392512, maxSingleShuffleLimit=138348128, mergeThreshold=365239072, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:38,295 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local835480914_0042_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:38,296 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#42 about to shuffle output of map attempt_local835480914_0042_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:38,296 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local835480914_0042_m_000000_0
2015-02-10 20:59:38,296 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:38,297 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:38,298 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:38,298 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:38,300 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:38,300 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:38,302 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:38,302 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:38,302 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:38,303 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:38,303 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:38,304 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:38,305 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:38,305 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:38,309 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:38,310 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_ALL"]
2015-02-10 20:59:38,322 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local835480914_0042_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:38,323 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:38,324 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local835480914_0042_r_000000_0 is allowed to commit now
2015-02-10 20:59:38,324 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local835480914_0042_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_ALL/_temporary/0/task_local835480914_0042_r_000000
2015-02-10 20:59:38,326 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:38,326 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local835480914_0042_r_000000_0' done.
2015-02-10 20:59:38,326 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local835480914_0042_r_000000_0
2015-02-10 20:59:38,327 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:38,346 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_ALL/_temporary
2015-02-10 20:59:38,374 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:38,404 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:38,405 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_ALL
2015-02-10 20:59:38,420 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:38,421 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:38,424 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_REPLACE
2015-02-10 20:59:38,439 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:38,440 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:38,444 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:38,446 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:38,446 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:38,449 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:38,450 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:38,450 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_SWAP"]
2015-02-10 20:59:38,450 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:38,450 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:38,450 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:38,452 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...platform/ALL_'field'_SWAP
2015-02-10 20:59:38,452 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:38,453 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:38,476 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:38,494 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:38,509 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local601118365_0043
2015-02-10 20:59:38,526 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity601118365/.staging/job_local601118365_0043/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:38,526 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity601118365/.staging/job_local601118365_0043/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:38,572 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local601118365_0043/job_local601118365_0043.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:38,572 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local601118365_0043/job_local601118365_0043.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:38,573 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:38,574 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local601118365_0043
2015-02-10 20:59:38,574 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:38,574 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:38,574 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:38,576 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:38,577 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local601118365_0043_m_000000_0
2015-02-10 20:59:38,578 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:38,579 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:38,580 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@49a8422e
2015-02-10 20:59:38,581 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:38,581 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:38,610 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:38,610 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:38,610 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:38,610 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:38,610 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:38,612 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:38,612 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:38,616 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:38,616 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:38,619 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:38,620 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:38,620 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:38,620 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:38,620 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:38,623 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:38,624 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local601118365_0043_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:38,626 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:38,626 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local601118365_0043_m_000000_0' done.
2015-02-10 20:59:38,627 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local601118365_0043_m_000000_0
2015-02-10 20:59:38,627 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:38,627 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:38,627 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local601118365_0043_r_000000_0
2015-02-10 20:59:38,629 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:38,629 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@49cf882
2015-02-10 20:59:38,630 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=553392512, maxSingleShuffleLimit=138348128, mergeThreshold=365239072, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:38,630 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local601118365_0043_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:38,631 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#43 about to shuffle output of map attempt_local601118365_0043_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:38,632 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local601118365_0043_m_000000_0
2015-02-10 20:59:38,632 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:38,632 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:38,633 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:38,633 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:38,635 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:38,635 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:38,636 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:38,637 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:38,637 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:38,637 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:38,637 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:38,638 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:38,638 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:38,638 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:38,642 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:38,642 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_SWAP"]
2015-02-10 20:59:38,654 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local601118365_0043_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:38,655 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:38,655 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local601118365_0043_r_000000_0 is allowed to commit now
2015-02-10 20:59:38,656 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local601118365_0043_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_SWAP/_temporary/0/task_local601118365_0043_r_000000
2015-02-10 20:59:38,657 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:38,657 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local601118365_0043_r_000000_0' done.
2015-02-10 20:59:38,657 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local601118365_0043_r_000000_0
2015-02-10 20:59:38,658 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:38,675 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_SWAP/_temporary
2015-02-10 20:59:38,704 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:38,737 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:38,738 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_'field'_SWAP
2015-02-10 20:59:38,753 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:38,754 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:38,758 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:38,760 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:38,760 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:38,763 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:38,764 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:38,764 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_-1"]
2015-02-10 20:59:38,764 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:38,764 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:38,764 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:38,765 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...lyplatform/ALL_UNKNOWN_-1
2015-02-10 20:59:38,765 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:38,766 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:38,789 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:38,807 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:38,821 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local814239493_0044
2015-02-10 20:59:38,838 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity814239493/.staging/job_local814239493_0044/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:38,838 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity814239493/.staging/job_local814239493_0044/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:38,884 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local814239493_0044/job_local814239493_0044.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:38,884 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local814239493_0044/job_local814239493_0044.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:38,886 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:38,886 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:38,886 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local814239493_0044
2015-02-10 20:59:38,887 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:38,887 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:38,889 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:38,889 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local814239493_0044_m_000000_0
2015-02-10 20:59:38,890 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:38,891 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:38,892 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@12da876
2015-02-10 20:59:38,893 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:38,893 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:38,922 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:38,922 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:38,922 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:38,922 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:38,922 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:38,923 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:38,924 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:38,927 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:38,927 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:38,930 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:38,930 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:38,931 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:38,931 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:38,931 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:38,933 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:38,935 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local814239493_0044_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:38,937 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:38,937 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local814239493_0044_m_000000_0' done.
2015-02-10 20:59:38,937 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local814239493_0044_m_000000_0
2015-02-10 20:59:38,937 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:38,938 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:38,938 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local814239493_0044_r_000000_0
2015-02-10 20:59:38,939 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:38,939 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@4dfbbcea
2015-02-10 20:59:38,940 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=553484288, maxSingleShuffleLimit=138371072, mergeThreshold=365299648, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:38,941 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local814239493_0044_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:38,942 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#44 about to shuffle output of map attempt_local814239493_0044_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:38,942 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local814239493_0044_m_000000_0
2015-02-10 20:59:38,942 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:38,943 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:38,944 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:38,944 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:38,945 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:38,945 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:38,947 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:38,947 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:38,947 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:38,947 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:38,948 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:38,948 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:38,948 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:38,949 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:38,952 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:38,952 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_-1"]
2015-02-10 20:59:38,964 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local814239493_0044_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:38,965 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:38,965 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local814239493_0044_r_000000_0 is allowed to commit now
2015-02-10 20:59:38,965 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local814239493_0044_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_-1/_temporary/0/task_local814239493_0044_r_000000
2015-02-10 20:59:38,967 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:38,967 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local814239493_0044_r_000000_0' done.
2015-02-10 20:59:38,967 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local814239493_0044_r_000000_0
2015-02-10 20:59:38,967 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:38,986 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_-1/_temporary
2015-02-10 20:59:39,015 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:39,045 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:39,046 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_-1
2015-02-10 20:59:39,061 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:39,062 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:39,065 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_'field'
2015-02-10 20:59:39,081 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:39,081 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:39,085 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:39,087 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:39,087 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:39,090 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:39,091 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:39,091 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_RESULTS"]
2015-02-10 20:59:39,091 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:39,091 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:39,091 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:39,092 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...tform/ALL_UNKNOWN_RESULTS
2015-02-10 20:59:39,092 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:39,093 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:39,116 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:39,135 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:39,149 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1659261201_0045
2015-02-10 20:59:39,166 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1659261201/.staging/job_local1659261201_0045/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:39,166 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1659261201/.staging/job_local1659261201_0045/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:39,210 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1659261201_0045/job_local1659261201_0045.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:39,211 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1659261201_0045/job_local1659261201_0045.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:39,212 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:39,212 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:39,213 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:39,212 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1659261201_0045
2015-02-10 20:59:39,213 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:39,215 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:39,215 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1659261201_0045_m_000000_0
2015-02-10 20:59:39,216 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:39,217 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:39,217 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@216b58fa
2015-02-10 20:59:39,218 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:39,219 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:39,247 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:39,247 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:39,247 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:39,247 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:39,247 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:39,248 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:39,248 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:39,252 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:39,252 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:39,255 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:39,255 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:39,255 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:39,255 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:39,255 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:39,258 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:39,260 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1659261201_0045_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:39,261 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:39,261 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1659261201_0045_m_000000_0' done.
2015-02-10 20:59:39,262 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1659261201_0045_m_000000_0
2015-02-10 20:59:39,262 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:39,262 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:39,262 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1659261201_0045_r_000000_0
2015-02-10 20:59:39,264 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:39,264 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@7006cfce
2015-02-10 20:59:39,265 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=553484288, maxSingleShuffleLimit=138371072, mergeThreshold=365299648, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:39,266 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1659261201_0045_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:39,267 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#45 about to shuffle output of map attempt_local1659261201_0045_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:39,267 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1659261201_0045_m_000000_0
2015-02-10 20:59:39,267 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:39,268 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:39,268 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:39,269 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:39,270 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:39,270 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:39,271 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:39,272 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:39,272 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:39,272 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:39,272 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:39,273 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:39,273 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:39,273 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:39,276 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:39,277 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_RESULTS"]
2015-02-10 20:59:39,288 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1659261201_0045_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:39,289 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:39,289 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local1659261201_0045_r_000000_0 is allowed to commit now
2015-02-10 20:59:39,290 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1659261201_0045_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_RESULTS/_temporary/0/task_local1659261201_0045_r_000000
2015-02-10 20:59:39,291 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:39,291 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1659261201_0045_r_000000_0' done.
2015-02-10 20:59:39,291 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1659261201_0045_r_000000_0
2015-02-10 20:59:39,292 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:39,311 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_RESULTS/_temporary
2015-02-10 20:59:39,340 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:39,368 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:39,369 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_RESULTS
2015-02-10 20:59:39,385 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:39,385 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:39,389 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:39,391 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:39,391 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:39,394 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:39,395 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:39,395 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_ALL"]
2015-02-10 20:59:39,395 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:39,395 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:39,395 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:39,396 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...yplatform/ALL_UNKNOWN_ALL
2015-02-10 20:59:39,396 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:39,397 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:39,420 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:39,437 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:39,451 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1570275348_0046
2015-02-10 20:59:39,467 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1570275348/.staging/job_local1570275348_0046/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:39,468 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1570275348/.staging/job_local1570275348_0046/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:39,511 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1570275348_0046/job_local1570275348_0046.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:39,511 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1570275348_0046/job_local1570275348_0046.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:39,512 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:39,512 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:39,512 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1570275348_0046
2015-02-10 20:59:39,513 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:39,513 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:39,515 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:39,515 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1570275348_0046_m_000000_0
2015-02-10 20:59:39,516 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:39,518 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:39,518 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@7ff7c46e
2015-02-10 20:59:39,519 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:39,519 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:39,549 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:39,550 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:39,550 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:39,550 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:39,551 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:39,552 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:39,552 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:39,556 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:39,556 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:39,559 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:39,559 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:39,559 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:39,559 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:39,560 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:39,562 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:39,564 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1570275348_0046_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:39,565 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:39,566 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1570275348_0046_m_000000_0' done.
2015-02-10 20:59:39,566 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1570275348_0046_m_000000_0
2015-02-10 20:59:39,566 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:39,566 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:39,567 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1570275348_0046_r_000000_0
2015-02-10 20:59:39,568 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:39,568 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@6c5a8d3b
2015-02-10 20:59:39,569 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=553576000, maxSingleShuffleLimit=138394000, mergeThreshold=365360160, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:39,570 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1570275348_0046_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:39,571 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#46 about to shuffle output of map attempt_local1570275348_0046_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:39,571 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1570275348_0046_m_000000_0
2015-02-10 20:59:39,571 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:39,572 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:39,573 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:39,573 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:39,576 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:39,576 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:39,577 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:39,578 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:39,578 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:39,578 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:39,578 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:39,579 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:39,579 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:39,579 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:39,583 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:39,583 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_ALL"]
2015-02-10 20:59:39,595 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1570275348_0046_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:39,596 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:39,596 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local1570275348_0046_r_000000_0 is allowed to commit now
2015-02-10 20:59:39,597 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1570275348_0046_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_ALL/_temporary/0/task_local1570275348_0046_r_000000
2015-02-10 20:59:39,598 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:39,599 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1570275348_0046_r_000000_0' done.
2015-02-10 20:59:39,599 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1570275348_0046_r_000000_0
2015-02-10 20:59:39,599 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:39,614 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_ALL/_temporary
2015-02-10 20:59:39,642 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:39,672 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:39,673 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_ALL
2015-02-10 20:59:39,690 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:39,690 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:39,695 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:39,696 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:39,697 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:39,700 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:39,700 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:39,701 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_REPLACE"]
2015-02-10 20:59:39,701 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:39,701 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:39,702 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:39,702 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...tform/ALL_UNKNOWN_REPLACE
2015-02-10 20:59:39,703 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:39,704 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:39,727 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:39,745 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:39,760 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1573602999_0047
2015-02-10 20:59:39,776 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1573602999/.staging/job_local1573602999_0047/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:39,776 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1573602999/.staging/job_local1573602999_0047/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:39,821 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:39,825 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1573602999_0047/job_local1573602999_0047.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:39,825 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1573602999_0047/job_local1573602999_0047.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:39,826 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:39,826 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1573602999_0047
2015-02-10 20:59:39,826 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:39,827 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:39,826 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:39,829 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:39,829 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1573602999_0047_m_000000_0
2015-02-10 20:59:39,831 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:39,833 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:39,833 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@55a2e547
2015-02-10 20:59:39,835 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:39,835 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:39,864 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:39,865 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:39,865 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:39,865 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:39,866 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:39,868 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:39,869 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:39,873 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:39,873 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:39,876 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:39,877 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:39,877 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:39,877 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:39,877 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:39,880 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:39,882 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1573602999_0047_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:39,884 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:39,884 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1573602999_0047_m_000000_0' done.
2015-02-10 20:59:39,885 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1573602999_0047_m_000000_0
2015-02-10 20:59:39,885 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:39,885 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:39,886 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1573602999_0047_r_000000_0
2015-02-10 20:59:39,887 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:39,888 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@c2ccccf
2015-02-10 20:59:39,889 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=553576000, maxSingleShuffleLimit=138394000, mergeThreshold=365360160, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:39,890 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1573602999_0047_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:39,891 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#47 about to shuffle output of map attempt_local1573602999_0047_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:39,891 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1573602999_0047_m_000000_0
2015-02-10 20:59:39,892 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:39,892 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:39,893 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:39,893 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:39,897 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:39,897 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:39,900 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:39,900 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:39,901 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:39,901 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:39,901 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:39,902 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:39,902 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:39,903 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:39,906 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:39,906 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_REPLACE"]
2015-02-10 20:59:39,914 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:39,915 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:39,916 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1573602999_0047
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:39,918 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local1573602999_0047 state at FAILED
2015-02-10 20:59:39,918 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 20:59:39,918 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 20:59:39,918 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 20:59:39,926 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 20:59:39,926 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...tform/ALL_UNKNOWN_REPLACE
2015-02-10 20:59:39,927 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 20:59:39,927 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_REPLACE/_temporary
2015-02-10 20:59:39,927 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_REPLACE
2015-02-10 20:59:39,943 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:39,943 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:39,947 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:39,949 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:39,950 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:39,952 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:39,953 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:39,953 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_SWAP"]
2015-02-10 20:59:39,953 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:39,953 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:39,953 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:39,954 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...platform/ALL_UNKNOWN_SWAP
2015-02-10 20:59:39,954 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:39,955 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:39,978 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:39,995 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:40,010 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1383678862_0048
2015-02-10 20:59:40,026 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1383678862/.staging/job_local1383678862_0048/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:40,027 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1383678862/.staging/job_local1383678862_0048/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:40,071 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1383678862_0048/job_local1383678862_0048.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:40,071 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1383678862_0048/job_local1383678862_0048.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:40,073 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:40,073 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:40,073 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:40,073 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1383678862_0048
2015-02-10 20:59:40,074 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:40,075 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:40,075 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1383678862_0048_m_000000_0
2015-02-10 20:59:40,076 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:40,078 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:40,078 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@54b216b3
2015-02-10 20:59:40,079 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:40,079 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:40,096 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:40,097 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:40,097 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:40,097 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:40,097 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:40,098 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:40,098 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:40,101 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:40,102 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:40,104 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:40,104 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:40,104 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:40,105 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:40,105 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:40,107 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:40,109 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1383678862_0048_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:40,110 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:40,110 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1383678862_0048_m_000000_0' done.
2015-02-10 20:59:40,121 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1383678862_0048_m_000000_0
2015-02-10 20:59:40,122 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:40,123 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:40,123 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1383678862_0048_r_000000_0
2015-02-10 20:59:40,125 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:40,125 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@37b2cb94
2015-02-10 20:59:40,126 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=553667776, maxSingleShuffleLimit=138416944, mergeThreshold=365420736, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:40,127 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1383678862_0048_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:40,129 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#48 about to shuffle output of map attempt_local1383678862_0048_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:40,129 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1383678862_0048_m_000000_0
2015-02-10 20:59:40,130 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:40,130 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:40,131 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:40,131 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:40,133 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:40,133 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:40,135 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:40,135 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:40,135 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:40,135 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:40,136 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:40,136 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:40,137 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:40,137 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:40,140 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:40,141 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_SWAP"]
2015-02-10 20:59:40,152 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1383678862_0048_r_000000_0 is done. And is in the process of committing
2015-02-10 20:59:40,153 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:40,153 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local1383678862_0048_r_000000_0 is allowed to commit now
2015-02-10 20:59:40,154 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1383678862_0048_r_000000_0' to file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_SWAP/_temporary/0/task_local1383678862_0048_r_000000
2015-02-10 20:59:40,155 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:40,155 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1383678862_0048_r_000000_0' done.
2015-02-10 20:59:40,155 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local1383678862_0048_r_000000_0
2015-02-10 20:59:40,155 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:40,176 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_SWAP/_temporary
2015-02-10 20:59:40,205 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:40,234 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:40,235 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_UNKNOWN_SWAP
2015-02-10 20:59:40,250 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:40,251 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:40,255 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:40,257 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:40,257 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:40,260 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:40,260 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:40,261 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_-1"]
2015-02-10 20:59:40,261 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:40,261 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:40,261 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:40,262 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...blyplatform/ALL_VALUES_-1
2015-02-10 20:59:40,263 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:40,263 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:40,288 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:40,307 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:40,322 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local660223014_0049
2015-02-10 20:59:40,339 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity660223014/.staging/job_local660223014_0049/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:40,340 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity660223014/.staging/job_local660223014_0049/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:40,386 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local660223014_0049/job_local660223014_0049.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:40,387 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local660223014_0049/job_local660223014_0049.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:40,388 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:40,389 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local660223014_0049
2015-02-10 20:59:40,389 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:40,389 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:40,390 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:40,392 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:40,392 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local660223014_0049_m_000000_0
2015-02-10 20:59:40,393 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:40,395 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:40,395 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@69e1968d
2015-02-10 20:59:40,396 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:40,396 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:40,413 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:40,415 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:40,415 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:40,415 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:40,416 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:40,415 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:40,418 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:40,419 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:40,422 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:40,422 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:40,425 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:40,425 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:40,425 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:40,425 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:40,425 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:40,428 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:40,429 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local660223014_0049_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:40,431 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:40,431 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local660223014_0049_m_000000_0' done.
2015-02-10 20:59:40,431 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local660223014_0049_m_000000_0
2015-02-10 20:59:40,431 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:40,432 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:40,432 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local660223014_0049_r_000000_0
2015-02-10 20:59:40,433 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:40,433 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@4e6358de
2015-02-10 20:59:40,434 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=553667776, maxSingleShuffleLimit=138416944, mergeThreshold=365420736, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:40,435 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local660223014_0049_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:40,436 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#49 about to shuffle output of map attempt_local660223014_0049_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:40,436 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local660223014_0049_m_000000_0
2015-02-10 20:59:40,436 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:40,437 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:40,437 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:40,438 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:40,439 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:40,439 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:40,440 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:40,441 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:40,441 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:40,441 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:40,441 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:40,442 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:40,442 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:40,442 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:40,445 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:40,446 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_-1"]
2015-02-10 20:59:40,453 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:40,454 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:40,456 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local660223014_0049
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:40,456 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local660223014_0049 state at FAILED
2015-02-10 20:59:40,456 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 20:59:40,456 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 20:59:40,457 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 20:59:40,460 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 20:59:40,460 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...blyplatform/ALL_VALUES_-1
2015-02-10 20:59:40,463 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 20:59:40,463 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_-1/_temporary
2015-02-10 20:59:40,464 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_-1
2015-02-10 20:59:40,479 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:40,479 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:40,483 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_'field'
2015-02-10 20:59:40,502 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:40,502 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:40,507 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:40,509 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:40,509 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:40,513 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:40,513 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:40,513 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_RESULTS"]
2015-02-10 20:59:40,514 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:40,514 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:40,514 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:40,515 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...atform/ALL_VALUES_RESULTS
2015-02-10 20:59:40,516 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:40,517 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:40,541 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:40,559 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:40,575 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1822655680_0050
2015-02-10 20:59:40,593 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1822655680/.staging/job_local1822655680_0050/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:40,594 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1822655680/.staging/job_local1822655680_0050/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:40,643 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1822655680_0050/job_local1822655680_0050.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:40,644 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1822655680_0050/job_local1822655680_0050.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:40,645 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:40,646 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:40,646 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:40,646 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1822655680_0050
2015-02-10 20:59:40,646 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:40,649 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:40,649 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1822655680_0050_m_000000_0
2015-02-10 20:59:40,650 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:40,651 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:40,652 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@2e24d74d
2015-02-10 20:59:40,653 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:40,653 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:40,681 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:40,682 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:40,682 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:40,682 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:40,682 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:40,683 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:40,683 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:40,684 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:40,687 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:40,687 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:40,689 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:40,690 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:40,690 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:40,690 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:40,690 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:40,692 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:40,694 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1822655680_0050_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:40,696 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:40,696 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1822655680_0050_m_000000_0' done.
2015-02-10 20:59:40,696 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1822655680_0050_m_000000_0
2015-02-10 20:59:40,696 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:40,697 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:40,697 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1822655680_0050_r_000000_0
2015-02-10 20:59:40,698 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:40,698 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@37fd3fc
2015-02-10 20:59:40,699 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=553759552, maxSingleShuffleLimit=138439888, mergeThreshold=365481312, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:40,699 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1822655680_0050_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:40,701 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#50 about to shuffle output of map attempt_local1822655680_0050_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:40,701 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1822655680_0050_m_000000_0
2015-02-10 20:59:40,701 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:40,702 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:40,702 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:40,702 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:40,704 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:40,704 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:40,705 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:40,706 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:40,706 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:40,706 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:40,706 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:40,707 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:40,707 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:40,707 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:40,710 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:40,710 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_RESULTS"]
2015-02-10 20:59:40,718 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:40,719 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:40,722 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1822655680_0050
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:40,722 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local1822655680_0050 state at FAILED
2015-02-10 20:59:40,723 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 20:59:40,723 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 20:59:40,723 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 20:59:40,726 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 20:59:40,727 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...atform/ALL_VALUES_RESULTS
2015-02-10 20:59:40,728 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 20:59:40,728 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_RESULTS/_temporary
2015-02-10 20:59:40,728 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_RESULTS
2015-02-10 20:59:40,744 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:40,744 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:40,749 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:40,750 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:40,751 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:40,754 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:40,754 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:40,755 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_ALL"]
2015-02-10 20:59:40,755 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:40,755 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:40,755 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:40,756 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...lyplatform/ALL_VALUES_ALL
2015-02-10 20:59:40,757 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:40,758 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:40,782 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:40,800 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:40,816 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local115798980_0051
2015-02-10 20:59:40,832 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity115798980/.staging/job_local115798980_0051/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:40,832 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity115798980/.staging/job_local115798980_0051/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:40,876 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local115798980_0051/job_local115798980_0051.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:40,877 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local115798980_0051/job_local115798980_0051.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:40,878 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:40,878 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:40,879 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:40,878 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local115798980_0051
2015-02-10 20:59:40,879 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:40,881 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:40,881 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local115798980_0051_m_000000_0
2015-02-10 20:59:40,882 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:40,883 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:40,883 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@741c42a9
2015-02-10 20:59:40,884 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:40,885 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:40,903 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:40,903 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:40,903 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:40,904 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:40,904 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:40,905 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:40,905 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:40,909 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:40,909 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:40,912 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:40,912 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:40,912 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:40,912 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:40,912 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:40,916 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:41,192 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:41,193 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local115798980_0051_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:41,195 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:41,195 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local115798980_0051_m_000000_0' done.
2015-02-10 20:59:41,195 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local115798980_0051_m_000000_0
2015-02-10 20:59:41,196 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:41,196 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:41,197 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local115798980_0051_r_000000_0
2015-02-10 20:59:41,198 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:41,198 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@239f768f
2015-02-10 20:59:41,199 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:41,199 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local115798980_0051_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:41,201 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#51 about to shuffle output of map attempt_local115798980_0051_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:41,202 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local115798980_0051_m_000000_0
2015-02-10 20:59:41,202 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:41,202 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:41,205 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:41,205 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:41,207 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:41,207 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:41,208 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:41,208 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:41,208 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:41,209 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:41,209 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:41,209 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:41,210 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:41,210 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:41,213 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:41,213 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_ALL"]
2015-02-10 20:59:41,221 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:41,221 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:41,223 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local115798980_0051
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:41,231 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local115798980_0051 state at FAILED
2015-02-10 20:59:41,231 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 20:59:41,232 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 20:59:41,232 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 20:59:41,235 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 20:59:41,235 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...lyplatform/ALL_VALUES_ALL
2015-02-10 20:59:41,236 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 20:59:41,236 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_ALL/_temporary
2015-02-10 20:59:41,237 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_ALL
2015-02-10 20:59:41,252 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:41,253 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:41,257 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:41,259 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:41,259 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:41,264 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:41,264 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:41,265 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_REPLACE"]
2015-02-10 20:59:41,265 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:41,266 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:41,266 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:41,267 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...atform/ALL_VALUES_REPLACE
2015-02-10 20:59:41,268 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:41,270 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:41,273 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:41,292 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:41,310 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:41,324 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1924989902_0052
2015-02-10 20:59:41,340 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1924989902/.staging/job_local1924989902_0052/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:41,340 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1924989902/.staging/job_local1924989902_0052/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:41,389 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1924989902_0052/job_local1924989902_0052.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:41,389 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1924989902_0052/job_local1924989902_0052.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:41,391 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:41,391 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:41,391 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1924989902_0052
2015-02-10 20:59:41,392 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:41,392 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:41,394 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:41,394 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1924989902_0052_m_000000_0
2015-02-10 20:59:41,396 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:41,397 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:41,397 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@284dbb2f
2015-02-10 20:59:41,399 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:41,399 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:41,417 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:41,417 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:41,417 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:41,417 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:41,418 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:41,420 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:41,420 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:41,424 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:41,424 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:41,427 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:41,427 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:41,427 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:41,427 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:41,427 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:41,430 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:41,431 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1924989902_0052_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:41,433 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:41,433 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1924989902_0052_m_000000_0' done.
2015-02-10 20:59:41,433 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1924989902_0052_m_000000_0
2015-02-10 20:59:41,433 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:41,434 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:41,434 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1924989902_0052_r_000000_0
2015-02-10 20:59:41,435 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:41,435 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@a7ab0f7
2015-02-10 20:59:41,436 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:41,437 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1924989902_0052_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:41,438 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#52 about to shuffle output of map attempt_local1924989902_0052_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:41,438 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1924989902_0052_m_000000_0
2015-02-10 20:59:41,438 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:41,439 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:41,439 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:41,440 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:41,443 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:41,443 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:41,445 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:41,445 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:41,445 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:41,445 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:41,446 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:41,446 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:41,447 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:41,447 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:41,450 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:41,450 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_REPLACE"]
2015-02-10 20:59:41,458 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:41,459 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:41,460 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1924989902_0052
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:41,464 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local1924989902_0052 state at FAILED
2015-02-10 20:59:41,464 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 20:59:41,464 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 20:59:41,464 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 20:59:41,467 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 20:59:41,468 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...atform/ALL_VALUES_REPLACE
2015-02-10 20:59:41,468 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 20:59:41,469 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_REPLACE/_temporary
2015-02-10 20:59:41,469 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_REPLACE
2015-02-10 20:59:41,484 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:41,485 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:41,489 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:41,491 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:41,491 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:41,494 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:41,494 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:41,495 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_SWAP"]
2015-02-10 20:59:41,495 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:41,495 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:41,495 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:41,496 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...yplatform/ALL_VALUES_SWAP
2015-02-10 20:59:41,496 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:41,497 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:41,512 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-10 20:59:41,520 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:41,537 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:41,551 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1716569034_0053
2015-02-10 20:59:41,567 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1716569034/.staging/job_local1716569034_0053/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:41,567 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1716569034/.staging/job_local1716569034_0053/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:41,610 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1716569034_0053/job_local1716569034_0053.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:41,611 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1716569034_0053/job_local1716569034_0053.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:41,612 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:41,612 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1716569034_0053
2015-02-10 20:59:41,612 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:41,612 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:41,613 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:41,642 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:41,643 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1716569034_0053_m_000000_0
2015-02-10 20:59:41,644 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:41,645 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:41,645 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@67c8f3da
2015-02-10 20:59:41,646 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:41,646 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:41,667 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:41,667 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:41,667 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:41,667 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:41,667 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:41,668 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:41,668 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:41,672 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:41,672 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:41,675 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:41,676 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:41,676 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:41,676 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:41,676 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:41,679 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:41,681 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1716569034_0053_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:41,682 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:41,683 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1716569034_0053_m_000000_0' done.
2015-02-10 20:59:41,683 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1716569034_0053_m_000000_0
2015-02-10 20:59:41,683 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:41,684 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:41,684 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1716569034_0053_r_000000_0
2015-02-10 20:59:41,685 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:41,686 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@7bb8597a
2015-02-10 20:59:41,686 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:41,687 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1716569034_0053_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:41,688 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#53 about to shuffle output of map attempt_local1716569034_0053_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:41,689 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1716569034_0053_m_000000_0
2015-02-10 20:59:41,689 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:41,689 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:41,690 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:41,690 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:41,692 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:41,692 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:41,694 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:41,694 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:41,694 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:41,695 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:41,695 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:41,696 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:41,696 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:41,696 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:41,699 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:41,700 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_SWAP"]
2015-02-10 20:59:41,707 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:41,710 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:41,712 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1716569034_0053
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: [NONE], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:41,714 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local1716569034_0053 state at FAILED
2015-02-10 20:59:41,714 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 20:59:41,714 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 20:59:41,715 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 20:59:41,718 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 20:59:41,718 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...yplatform/ALL_VALUES_SWAP
2015-02-10 20:59:41,719 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 20:59:41,719 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_SWAP/_temporary
2015-02-10 20:59:41,720 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_VALUES_SWAP
2015-02-10 20:59:41,735 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:41,735 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:41,740 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:41,741 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:41,742 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:41,745 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:41,745 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:41,745 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_-1"]
2015-02-10 20:59:41,745 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:41,745 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:41,745 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:41,746 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...emblyplatform/ALL_ARGS_-1
2015-02-10 20:59:41,746 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:41,748 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:41,771 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:41,789 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:41,803 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1982776983_0054
2015-02-10 20:59:41,819 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1982776983/.staging/job_local1982776983_0054/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:41,820 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1982776983/.staging/job_local1982776983_0054/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:41,865 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1982776983_0054/job_local1982776983_0054.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:41,865 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1982776983_0054/job_local1982776983_0054.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:41,866 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:41,866 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1982776983_0054
2015-02-10 20:59:41,866 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:41,867 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:41,867 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:41,869 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:41,869 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1982776983_0054_m_000000_0
2015-02-10 20:59:41,870 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:41,872 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:41,872 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@24a617aa
2015-02-10 20:59:41,873 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:41,873 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:41,891 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:41,891 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:41,891 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:41,892 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:41,892 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:41,893 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:41,893 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:41,897 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:41,897 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:41,900 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:41,900 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:41,901 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:41,901 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:41,901 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:41,904 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:41,905 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1982776983_0054_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:41,907 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:41,907 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1982776983_0054_m_000000_0' done.
2015-02-10 20:59:41,908 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1982776983_0054_m_000000_0
2015-02-10 20:59:41,908 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:41,908 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:41,909 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1982776983_0054_r_000000_0
2015-02-10 20:59:41,910 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:41,910 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@4f7b9ed4
2015-02-10 20:59:41,911 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:41,912 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1982776983_0054_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:41,913 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#54 about to shuffle output of map attempt_local1982776983_0054_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:41,914 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1982776983_0054_m_000000_0
2015-02-10 20:59:41,914 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:41,914 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:41,915 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:41,915 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:41,920 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:41,920 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:41,921 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:41,922 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:41,922 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:41,922 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:41,923 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:41,924 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:41,924 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:41,924 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:41,929 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:41,930 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_-1"]
2015-02-10 20:59:41,939 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:41,939 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:41,941 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1982776983_0054
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:41,949 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local1982776983_0054 state at FAILED
2015-02-10 20:59:41,949 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 20:59:41,949 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 20:59:41,949 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 20:59:41,952 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 20:59:41,953 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...emblyplatform/ALL_ARGS_-1
2015-02-10 20:59:41,953 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 20:59:41,954 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_-1/_temporary
2015-02-10 20:59:41,954 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_-1
2015-02-10 20:59:41,969 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:41,970 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:41,973 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_'field'
2015-02-10 20:59:41,988 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:41,988 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:41,993 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:41,994 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:41,995 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:41,997 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:41,998 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:41,998 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_RESULTS"]
2015-02-10 20:59:41,998 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:41,998 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:41,998 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:41,999 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...platform/ALL_ARGS_RESULTS
2015-02-10 20:59:41,999 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:42,000 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:42,022 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:42,040 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:42,055 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1866321725_0055
2015-02-10 20:59:42,072 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1866321725/.staging/job_local1866321725_0055/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:42,072 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1866321725/.staging/job_local1866321725_0055/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:42,116 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1866321725_0055/job_local1866321725_0055.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:42,116 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1866321725_0055/job_local1866321725_0055.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:42,117 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:42,117 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1866321725_0055
2015-02-10 20:59:42,117 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:42,117 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:42,118 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:42,120 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:42,120 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1866321725_0055_m_000000_0
2015-02-10 20:59:42,121 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:42,123 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:42,123 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@ed5ad5d
2015-02-10 20:59:42,124 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:42,124 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:42,143 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:42,143 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:42,143 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:42,143 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:42,143 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:42,144 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:42,145 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:42,148 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:42,148 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:42,151 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:42,151 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:42,151 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:42,152 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:42,152 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:42,155 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:42,156 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1866321725_0055_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:42,158 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:42,158 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1866321725_0055_m_000000_0' done.
2015-02-10 20:59:42,158 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1866321725_0055_m_000000_0
2015-02-10 20:59:42,158 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:42,159 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:42,160 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1866321725_0055_r_000000_0
2015-02-10 20:59:42,161 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:42,161 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@38e00a5e
2015-02-10 20:59:42,162 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:42,163 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1866321725_0055_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:42,164 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#55 about to shuffle output of map attempt_local1866321725_0055_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:42,165 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1866321725_0055_m_000000_0
2015-02-10 20:59:42,165 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:42,166 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:42,167 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:42,167 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:42,168 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:42,169 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:42,170 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:42,170 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:42,170 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:42,170 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:42,171 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:42,171 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:42,172 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:42,172 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:42,175 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:42,175 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_RESULTS"]
2015-02-10 20:59:42,183 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:42,184 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:42,186 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1866321725_0055
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:42,189 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local1866321725_0055 state at FAILED
2015-02-10 20:59:42,189 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 20:59:42,189 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 20:59:42,190 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 20:59:42,193 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 20:59:42,193 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...platform/ALL_ARGS_RESULTS
2015-02-10 20:59:42,194 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 20:59:42,194 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_RESULTS/_temporary
2015-02-10 20:59:42,195 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_RESULTS
2015-02-10 20:59:42,210 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:42,211 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:42,214 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_ALL
2015-02-10 20:59:42,229 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:42,230 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:42,234 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:42,235 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:42,236 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:42,239 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:42,239 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:42,239 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_REPLACE"]
2015-02-10 20:59:42,240 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:42,240 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:42,241 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:42,241 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...platform/ALL_ARGS_REPLACE
2015-02-10 20:59:42,242 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:42,243 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:42,267 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:42,285 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:42,299 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local252351053_0056
2015-02-10 20:59:42,315 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity252351053/.staging/job_local252351053_0056/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:42,315 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity252351053/.staging/job_local252351053_0056/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:42,360 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local252351053_0056/job_local252351053_0056.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:42,360 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local252351053_0056/job_local252351053_0056.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:42,361 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:42,361 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:42,362 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:42,361 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local252351053_0056
2015-02-10 20:59:42,362 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:42,363 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:42,364 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local252351053_0056_m_000000_0
2015-02-10 20:59:42,365 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:42,366 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:42,366 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@ea80f3a
2015-02-10 20:59:42,367 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:42,367 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:42,387 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:42,388 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:42,388 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:42,388 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:42,388 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:42,389 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:42,389 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:42,392 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:42,393 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:42,395 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:42,395 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:42,396 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:42,396 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:42,396 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:42,401 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:42,403 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local252351053_0056_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:42,404 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:42,405 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local252351053_0056_m_000000_0' done.
2015-02-10 20:59:42,405 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local252351053_0056_m_000000_0
2015-02-10 20:59:42,405 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:42,406 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:42,406 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local252351053_0056_r_000000_0
2015-02-10 20:59:42,407 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:42,408 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@2c028bbe
2015-02-10 20:59:42,408 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:42,409 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local252351053_0056_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:42,411 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#56 about to shuffle output of map attempt_local252351053_0056_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:42,411 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local252351053_0056_m_000000_0
2015-02-10 20:59:42,411 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:42,412 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:42,413 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:42,413 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:42,415 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:42,415 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:42,416 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:42,417 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:42,417 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:42,417 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:42,418 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:42,418 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:42,419 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:42,419 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:42,422 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:42,423 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_REPLACE"]
2015-02-10 20:59:42,430 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:42,433 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:42,435 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local252351053_0056
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:42,444 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local252351053_0056 state at FAILED
2015-02-10 20:59:42,444 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 20:59:42,444 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 20:59:42,444 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 20:59:42,447 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 20:59:42,448 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...platform/ALL_ARGS_REPLACE
2015-02-10 20:59:42,448 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 20:59:42,449 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_REPLACE/_temporary
2015-02-10 20:59:42,449 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_REPLACE
2015-02-10 20:59:42,464 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-10 20:59:42,465 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /opt/concurrent/home/teamcity/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-10 20:59:42,469 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-10 20:59:42,471 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-10 20:59:42,471 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-10 20:59:42,474 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting
2015-02-10 20:59:42,474 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:42,474 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_SWAP"]
2015-02-10 20:59:42,474 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] parallel execution is enabled: false
2015-02-10 20:59:42,474 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] starting jobs: 1
2015-02-10 20:59:42,475 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] allocating threads: 1
2015-02-10 20:59:42,475 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] starting step: (1/1) ...blyplatform/ALL_ARGS_SWAP
2015-02-10 20:59:42,476 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:42,477 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-10 20:59:42,500 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-02-10 20:59:42,517 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2015-02-10 20:59:42,531 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1715153079_0057
2015-02-10 20:59:42,547 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1715153079/.staging/job_local1715153079_0057/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:42,548 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/tmp/cascading/staging/teamcity1715153079/.staging/job_local1715153079_0057/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:42,591 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1715153079_0057/job_local1715153079_0057.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2015-02-10 20:59:42,592 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/tmp/mapred/local/localRunner/teamcity/job_local1715153079_0057/job_local1715153079_0057.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2015-02-10 20:59:42,593 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2015-02-10 20:59:42,593 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] submitted hadoop job: job_local1715153079_0057
2015-02-10 20:59:42,593 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-10 20:59:42,593 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] tracking url: http://localhost:8080/
2015-02-10 20:59:42,593 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-10 20:59:42,595 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-10 20:59:42,596 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1715153079_0057_m_000000_0
2015-02-10 20:59:42,597 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:42,598 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt
2015-02-10 20:59:42,598 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@cbc5ae4
2015-02-10 20:59:42,599 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2015-02-10 20:59:42,599 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-10 20:59:42,617 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-10 20:59:42,617 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2015-02-10 20:59:42,617 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2015-02-10 20:59:42,617 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2015-02-10 20:59:42,617 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2015-02-10 20:59:42,618 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-10 20:59:42,619 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-10 20:59:42,622 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt"]
2015-02-10 20:59:42,622 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:42,625 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-10 20:59:42,625 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2015-02-10 20:59:42,625 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2015-02-10 20:59:42,625 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 251; bufvoid = 104857600
2015-02-10 20:59:42,625 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26214320(104857280); length = 77/6553600
2015-02-10 20:59:42,628 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2015-02-10 20:59:42,630 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1715153079_0057_m_000000_0 is done. And is in the process of committing
2015-02-10 20:59:42,631 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/classes/test/data/nums.20.txt:0+51
2015-02-10 20:59:42,631 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1715153079_0057_m_000000_0' done.
2015-02-10 20:59:42,632 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1715153079_0057_m_000000_0
2015-02-10 20:59:42,632 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-10 20:59:42,633 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-10 20:59:42,633 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local1715153079_0057_r_000000_0
2015-02-10 20:59:42,634 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2015-02-10 20:59:42,634 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@2221bcd5
2015-02-10 20:59:42,635 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-10 20:59:42,636 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local1715153079_0057_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-10 20:59:42,637 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#57 about to shuffle output of map attempt_local1715153079_0057_m_000000_0 decomp: 293 len: 297 to MEMORY
2015-02-10 20:59:42,637 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 293 bytes from map-output for attempt_local1715153079_0057_m_000000_0
2015-02-10 20:59:42,638 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 293, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->293
2015-02-10 20:59:42,638 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-10 20:59:42,641 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:42,642 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-10 20:59:42,646 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:42,647 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:42,649 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 293 bytes to disk to satisfy reduce memory limit
2015-02-10 20:59:42,649 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 297 bytes from disk
2015-02-10 20:59:42,650 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-10 20:59:42,650 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2015-02-10 20:59:42,651 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 282 bytes
2015-02-10 20:59:42,652 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-10 20:59:42,653 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-10 20:59:42,653 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-10 20:59:42,657 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(every)[by:[{?}:ALL]]
2015-02-10 20:59:42,658 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_SWAP"]
2015-02-10 20:59:42,665 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:42,666 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-10 20:59:42,668 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local1715153079_0057
java.lang.Exception: cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: cascading.tuple.TupleException: operation added the wrong number of fields, expected: ['offset', 'line'], got result size: 1
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:125)
at cascading.TestAggregator.complete(TestAggregator.java:96)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:151)
at cascading.flow.stream.AggregatorEveryStage.completeGroup(AggregatorEveryStage.java:39)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:51)
at cascading.flow.stream.OpenReducingDuct.receive(OpenReducingDuct.java:28)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:93)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:136)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
2015-02-10 20:59:42,675 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] hadoop job job_local1715153079_0057 state at FAILED
2015-02-10 20:59:42,675 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] failure info: NA
2015-02-10 20:59:42,675 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events identify failed tasks
2015-02-10 20:59:42,675 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [every] task completion events count: 0
2015-02-10 20:59:42,678 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopping all jobs
2015-02-10 20:59:42,679 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [every] stopping: (1/1) ...blyplatform/ALL_ARGS_SWAP
2015-02-10 20:59:42,679 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [every] stopped all jobs
2015-02-10 20:59:42,680 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output/hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_SWAP/_temporary
2015-02-10 20:59:42,680 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /opt/buildAgent-8.0.3/work/84ab5c9b70b89230/apache-2.3.x/build/test/output//hadoop2-mr1/everypipeassemblyplatform/ALL_ARGS_SWAP