2014-04-10 11:32:39,553 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(187)) - found 1 test platforms from classpath
2014-04-10 11:32:39,577 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(237)) - installing platform: hadoop2-mr1
2014-04-10 11:32:39,577 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(238)) - running test: cascading.function.FunctionPlatformTest
2014-04-10 11:32:39,588 INFO hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(106)) - not using cluster
2014-04-10 11:32:39,868 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2014-04-10 11:32:39,955 INFO assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-10 11:32:39,958 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-10 11:32:39,958 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 399, total: 480, max: 672
2014-04-10 11:32:39,958 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-10 11:32:39,958 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-10 11:32:39,958 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 399, total: 480, max: 672
2014-04-10 11:32:39,959 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-10 11:32:40,006 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-10 11:32:40,007 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.3/fbde5367797af408c100d25704a77959e50a31d8/cascading-hadoop2-mr1-2.5.3.jar
2014-04-10 11:32:40,012 INFO property.AppProps (AppProps.java:getAppID(162)) - using app.id: 0A7BD133542640BAB91506A7AA42C131
2014-04-10 11:32:40,044 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-04-10 11:32:40,061 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-04-10 11:32:40,063 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-04-10 11:32:40,114 INFO util.Version (Version.java:printBanner(78)) - Concurrent, Inc - Cascading 2.5.3
2014-04-10 11:32:40,116 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [formatter] starting
2014-04-10 11:32:40,116 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [formatter] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/upper.txt"]
2014-04-10 11:32:40,116 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [formatter] sink: Hfs["TextLine[['line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/functionplatform/formatter"]
2014-04-10 11:32:40,117 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [formatter] parallel execution is enabled: false
2014-04-10 11:32:40,117 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [formatter] starting jobs: 1
2014-04-10 11:32:40,117 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [formatter] allocating threads: 1
2014-04-10 11:32:40,118 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [formatter] starting step: (1/1) ...unctionplatform/formatter
2014-04-10 11:32:40,130 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - session.id is deprecated. Instead, use dfs.metrics.session-id
2014-04-10 11:32:40,131 INFO jvm.JvmMetrics (JvmMetrics.java:init(76)) - Initializing JVM Metrics with processName=JobTracker, sessionId=
2014-04-10 11:32:40,141 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-04-10 11:32:40,286 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:32:40,303 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-04-10 11:32:40,394 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local208447188_0001
2014-04-10 11:32:40,415 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/staging/brock208447188/.staging/job_local208447188_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2014-04-10 11:32:40,415 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/staging/brock208447188/.staging/job_local208447188_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2014-04-10 11:32:40,526 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/local/localRunner/brock/job_local208447188_0001/job_local208447188_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2014-04-10 11:32:40,527 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/local/localRunner/brock/job_local208447188_0001/job_local208447188_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2014-04-10 11:32:40,534 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-04-10 11:32:40,535 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-04-10 11:32:40,535 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [formatter] submitted hadoop job: job_local208447188_0001
2014-04-10 11:32:40,535 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [formatter] tracking url: http://localhost:8080/
2014-04-10 11:32:40,535 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-04-10 11:32:40,563 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-04-10 11:32:40,565 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local208447188_0001_m_000000_0
2014-04-10 11:32:40,582 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2014-04-10 11:32:40,587 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/upper.txt
2014-04-10 11:32:40,587 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@4687a14f
2014-04-10 11:32:40,592 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 0
2014-04-10 11:32:40,599 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-10 11:32:40,599 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-10 11:32:40,618 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.task.partition is deprecated. Instead, use mapreduce.task.partition
2014-04-10 11:32:40,619 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/upper.txt"]
2014-04-10 11:32:40,619 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: Hfs["TextLine[['line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/functionplatform/formatter"]
2014-04-10 11:32:40,627 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2014-04-10 11:32:40,627 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local208447188_0001_m_000000_0 is done. And is in the process of committing
2014-04-10 11:32:40,631 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2014-04-10 11:32:40,631 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local208447188_0001_m_000000_0 is allowed to commit now
2014-04-10 11:32:40,632 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local208447188_0001_m_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/functionplatform/formatter/_temporary/0/task_local208447188_0001_m_000000
2014-04-10 11:32:40,633 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/upper.txt:0+19
2014-04-10 11:32:40,633 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local208447188_0001_m_000000_0' done.
2014-04-10 11:32:40,633 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local208447188_0001_m_000000_0
2014-04-10 11:32:40,634 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-04-10 11:32:40,656 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/functionplatform/formatter/_temporary
2014-04-10 11:32:40,673 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:32:40,694 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:32:40,695 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output//hadoop2-mr1/functionplatform/formatter
2014-04-10 11:32:40,697 INFO assembly.AggregateBy (AggregateBy.java:prepare(248)) - using threshold value: 2
2014-04-10 11:32:40,697 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 1, with threshold: 2
2014-04-10 11:32:40,697 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 421, total: 480, max: 672
2014-04-10 11:32:40,697 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-10 11:32:40,698 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(307)) - flushed keys num times: 3, with threshold: 2
2014-04-10 11:32:40,698 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(308)) - mem on flush (mb), free: 421, total: 480, max: 672
2014-04-10 11:32:40,698 INFO assembly.AggregateBy (AggregateBy.java:removeEldestEntry(313)) - total mem is 71% of max mem, to better utilize unused memory consider increasing current LRU threshold with system property "cascading.aggregateby.threshold"
2014-04-10 11:32:40,714 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-10 11:32:40,715 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.3/fbde5367797af408c100d25704a77959e50a31d8/cascading-hadoop2-mr1-2.5.3.jar
2014-04-10 11:32:40,722 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-04-10 11:32:40,725 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-04-10 11:32:40,726 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-04-10 11:32:40,736 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [apache] starting
2014-04-10 11:32:40,736 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [apache] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/apache.200.txt"]
2014-04-10 11:32:40,736 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [apache] sink: Hfs["TextLine[['line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/functionplatform/insert"]
2014-04-10 11:32:40,736 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [apache] parallel execution is enabled: false
2014-04-10 11:32:40,737 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [apache] starting jobs: 1
2014-04-10 11:32:40,737 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [apache] allocating threads: 1
2014-04-10 11:32:40,737 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [apache] starting step: (1/1) ...1/functionplatform/insert
2014-04-10 11:32:40,738 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-04-10 11:32:40,739 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-04-10 11:32:40,761 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:32:40,776 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-04-10 11:32:40,802 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local2111344471_0002
2014-04-10 11:32:40,812 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/staging/brock2111344471/.staging/job_local2111344471_0002/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2014-04-10 11:32:40,812 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/staging/brock2111344471/.staging/job_local2111344471_0002/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2014-04-10 11:32:40,850 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/local/localRunner/brock/job_local2111344471_0002/job_local2111344471_0002.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2014-04-10 11:32:40,850 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/local/localRunner/brock/job_local2111344471_0002/job_local2111344471_0002.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2014-04-10 11:32:40,851 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-04-10 11:32:40,851 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [apache] submitted hadoop job: job_local2111344471_0002
2014-04-10 11:32:40,851 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-04-10 11:32:40,851 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [apache] tracking url: http://localhost:8080/
2014-04-10 11:32:40,851 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-04-10 11:32:40,854 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-04-10 11:32:40,854 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local2111344471_0002_m_000000_0
2014-04-10 11:32:40,855 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2014-04-10 11:32:40,856 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/apache.200.txt
2014-04-10 11:32:40,856 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@4ea386b8
2014-04-10 11:32:40,857 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 1
2014-04-10 11:32:40,860 INFO mapred.MapTask (MapTask.java:createSortingCollector(388)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2014-04-10 11:32:40,871 INFO mapred.MapTask (MapTask.java:setEquator(1181)) - (EQUATOR) 0 kvi 26214396(104857584)
2014-04-10 11:32:40,871 INFO mapred.MapTask (MapTask.java:init(975)) - mapreduce.task.io.sort.mb: 100
2014-04-10 11:32:40,871 INFO mapred.MapTask (MapTask.java:init(976)) - soft limit at 83886080
2014-04-10 11:32:40,871 INFO mapred.MapTask (MapTask.java:init(977)) - bufstart = 0; bufvoid = 104857600
2014-04-10 11:32:40,871 INFO mapred.MapTask (MapTask.java:init(978)) - kvstart = 26214396; length = 6553600
2014-04-10 11:32:40,878 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-10 11:32:40,879 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-10 11:32:40,887 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/apache.200.txt"]
2014-04-10 11:32:40,887 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: GroupBy(apache)[by:[{1}:'A']]
2014-04-10 11:32:40,899 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2014-04-10 11:32:40,899 INFO mapred.MapTask (MapTask.java:flush(1435)) - Starting flush of map output
2014-04-10 11:32:40,899 INFO mapred.MapTask (MapTask.java:flush(1453)) - Spilling map output
2014-04-10 11:32:40,899 INFO mapred.MapTask (MapTask.java:flush(1454)) - bufstart = 0; bufend = 3000; bufvoid = 104857600
2014-04-10 11:32:40,899 INFO mapred.MapTask (MapTask.java:flush(1456)) - kvstart = 26214396(104857584); kvend = 26213600(104854400); length = 797/6553600
2014-04-10 11:32:40,909 INFO mapred.MapTask (MapTask.java:sortAndSpill(1639)) - Finished spill 0
2014-04-10 11:32:40,910 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local2111344471_0002_m_000000_0 is done. And is in the process of committing
2014-04-10 11:32:40,912 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/apache.200.txt:0+32599
2014-04-10 11:32:40,912 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local2111344471_0002_m_000000_0' done.
2014-04-10 11:32:40,912 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local2111344471_0002_m_000000_0
2014-04-10 11:32:40,912 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-04-10 11:32:40,914 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2014-04-10 11:32:40,915 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local2111344471_0002_r_000000_0
2014-04-10 11:32:40,917 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2014-04-10 11:32:40,919 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@a8db40d
2014-04-10 11:32:40,926 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(193)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2014-04-10 11:32:40,928 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local2111344471_0002_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2014-04-10 11:32:40,951 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(140)) - localfetcher#1 about to shuffle output of map attempt_local2111344471_0002_m_000000_0 decomp: 3402 len: 3406 to MEMORY
2014-04-10 11:32:40,952 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 3402 bytes from map-output for attempt_local2111344471_0002_m_000000_0
2014-04-10 11:32:40,973 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(307)) - closeInMemoryFile -> map-output of size: 3402, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->3402
2014-04-10 11:32:40,974 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2014-04-10 11:32:40,975 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-04-10 11:32:40,976 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(667)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2014-04-10 11:32:40,981 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-04-10 11:32:40,981 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 3393 bytes
2014-04-10 11:32:40,985 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(742)) - Merged 1 segments, 3402 bytes to disk to satisfy reduce memory limit
2014-04-10 11:32:40,985 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(772)) - Merging 1 files, 3406 bytes from disk
2014-04-10 11:32:40,985 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(787)) - Merging 0 segments, 0 bytes from memory into reduce
2014-04-10 11:32:40,985 INFO mapred.Merger (Merger.java:merge(589)) - Merging 1 sorted segments
2014-04-10 11:32:40,986 INFO mapred.Merger (Merger.java:merge(688)) - Down to the last merge-pass, with 1 segments left of total size: 3393 bytes
2014-04-10 11:32:40,986 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-04-10 11:32:40,987 INFO hadoop.FlowReducer (FlowReducer.java:configure(77)) - cascading version: 2.5.3
2014-04-10 11:32:40,987 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - child jvm opts: -Xmx200m
2014-04-10 11:32:40,994 INFO hadoop.FlowReducer (FlowReducer.java:configure(96)) - sourcing from: GroupBy(apache)[by:[{1}:'A']]
2014-04-10 11:32:40,994 INFO hadoop.FlowReducer (FlowReducer.java:configure(99)) - sinking to: Hfs["TextLine[['line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/functionplatform/insert"]
2014-04-10 11:32:41,018 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local2111344471_0002_r_000000_0 is done. And is in the process of committing
2014-04-10 11:32:41,020 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2014-04-10 11:32:41,020 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local2111344471_0002_r_000000_0 is allowed to commit now
2014-04-10 11:32:41,020 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local2111344471_0002_r_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/functionplatform/insert/_temporary/0/task_local2111344471_0002_r_000000
2014-04-10 11:32:41,021 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2014-04-10 11:32:41,021 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local2111344471_0002_r_000000_0' done.
2014-04-10 11:32:41,021 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local2111344471_0002_r_000000_0
2014-04-10 11:32:41,021 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2014-04-10 11:32:41,038 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/functionplatform/insert/_temporary
2014-04-10 11:32:41,053 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:32:41,072 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:32:41,075 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output//hadoop2-mr1/functionplatform/insert
2014-04-10 11:32:41,089 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-10 11:32:41,089 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.3/fbde5367797af408c100d25704a77959e50a31d8/cascading-hadoop2-mr1-2.5.3.jar
2014-04-10 11:32:41,096 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-04-10 11:32:41,098 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-04-10 11:32:41,099 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-04-10 11:32:41,106 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [setvalue] starting
2014-04-10 11:32:41,106 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [setvalue] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/upper.txt"]
2014-04-10 11:32:41,106 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [setvalue] sink: Hfs["TextLine[['line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/functionplatform/setvalue"]
2014-04-10 11:32:41,106 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [setvalue] parallel execution is enabled: false
2014-04-10 11:32:41,106 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [setvalue] starting jobs: 1
2014-04-10 11:32:41,107 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [setvalue] allocating threads: 1
2014-04-10 11:32:41,107 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [setvalue] starting step: (1/1) ...functionplatform/setvalue
2014-04-10 11:32:41,107 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-04-10 11:32:41,108 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-04-10 11:32:41,119 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:32:41,126 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-04-10 11:32:41,146 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1777434433_0003
2014-04-10 11:32:41,158 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/staging/brock1777434433/.staging/job_local1777434433_0003/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2014-04-10 11:32:41,158 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/staging/brock1777434433/.staging/job_local1777434433_0003/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2014-04-10 11:32:41,202 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/local/localRunner/brock/job_local1777434433_0003/job_local1777434433_0003.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2014-04-10 11:32:41,203 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/local/localRunner/brock/job_local1777434433_0003/job_local1777434433_0003.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2014-04-10 11:32:41,204 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-04-10 11:32:41,204 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [setvalue] submitted hadoop job: job_local1777434433_0003
2014-04-10 11:32:41,204 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-04-10 11:32:41,205 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [setvalue] tracking url: http://localhost:8080/
2014-04-10 11:32:41,205 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-04-10 11:32:41,206 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-04-10 11:32:41,206 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1777434433_0003_m_000000_0
2014-04-10 11:32:41,208 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2014-04-10 11:32:41,208 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/upper.txt
2014-04-10 11:32:41,208 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@f66751
2014-04-10 11:32:41,210 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 0
2014-04-10 11:32:41,213 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-10 11:32:41,213 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-10 11:32:41,221 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/upper.txt"]
2014-04-10 11:32:41,221 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: Hfs["TextLine[['line']->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/functionplatform/setvalue"]
2014-04-10 11:32:41,223 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2014-04-10 11:32:41,224 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1777434433_0003_m_000000_0 is done. And is in the process of committing
2014-04-10 11:32:41,225 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2014-04-10 11:32:41,225 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local1777434433_0003_m_000000_0 is allowed to commit now
2014-04-10 11:32:41,226 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1777434433_0003_m_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/functionplatform/setvalue/_temporary/0/task_local1777434433_0003_m_000000
2014-04-10 11:32:41,227 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/upper.txt:0+19
2014-04-10 11:32:41,227 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1777434433_0003_m_000000_0' done.
2014-04-10 11:32:41,227 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1777434433_0003_m_000000_0
2014-04-10 11:32:41,227 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-04-10 11:32:41,239 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/functionplatform/setvalue/_temporary
2014-04-10 11:32:41,254 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:32:41,270 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:32:41,271 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output//hadoop2-mr1/functionplatform/setvalue