2015-02-12 11:52:18,709 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(187)) - found 1 test platforms from classpath
2015-02-12 11:52:18,741 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(237)) - installing platform: hadoop2-mr1
2015-02-12 11:52:18,741 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(238)) - running test: cascading.flow.FlowStrategiesPlatformTest
2015-02-12 11:52:18,754 INFO hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(105)) - not using cluster
2015-02-12 11:52:19,303 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2015-02-12 11:52:19,467 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 11:52:19,469 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 11:52:19,483 INFO property.AppProps (AppProps.java:getAppID(169)) - using app.id: 1C08E5496C14485096348DE6AA2F94BA
2015-02-12 11:52:19,535 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1051)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-12 11:52:19,574 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1051)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-12 11:52:19,577 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1051)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-12 11:52:19,622 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] at least one sink is marked for delete
2015-02-12 11:52:19,626 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] sink oldest modified date: Wed Dec 31 15:59:59 PST 1969
2015-02-12 11:52:19,629 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] at least one sink is marked for delete
2015-02-12 11:52:19,629 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] sink oldest modified date: Wed Dec 31 15:59:59 PST 1969
2015-02-12 11:52:19,674 INFO util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 2.6.3
2015-02-12 11:52:19,677 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] starting
2015-02-12 11:52:19,677 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt"]
2015-02-12 11:52:19,678 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/flowstrategiesplatform/replace"]
2015-02-12 11:52:19,678 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] parallel execution is enabled: false
2015-02-12 11:52:19,678 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] starting jobs: 1
2015-02-12 11:52:19,678 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] allocating threads: 1
2015-02-12 11:52:19,679 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] starting step: (1/1) ...trategiesplatform/replace
2015-02-12 11:52:19,698 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1051)) - session.id is deprecated. Instead, use dfs.metrics.session-id
2015-02-12 11:52:19,699 INFO jvm.JvmMetrics (JvmMetrics.java:init(76)) - Initializing JVM Metrics with processName=JobTracker, sessionId=
2015-02-12 11:52:19,721 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-12 11:52:19,914 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 11:52:19,939 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(494)) - number of splits:1
2015-02-12 11:52:20,085 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(583)) - Submitting tokens for job: job_local128435816_0001
2015-02-12 11:52:20,231 INFO mapreduce.Job (Job.java:submit(1300)) - The url to track the job: http://localhost:8080/
2015-02-12 11:52:20,232 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-12 11:52:20,233 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] submitted hadoop job: job_local128435816_0001
2015-02-12 11:52:20,233 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] tracking url: http://localhost:8080/
2015-02-12 11:52:20,233 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-12 11:52:20,266 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-12 11:52:20,268 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local128435816_0001_m_000000_0
2015-02-12 11:52:20,290 INFO util.ProcfsBasedProcessTree (ProcfsBasedProcessTree.java:isAvailable(181)) - ProcfsBasedProcessTree currently is supported only on Linux.
2015-02-12 11:52:20,291 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : null
2015-02-12 11:52:20,296 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt
2015-02-12 11:52:20,296 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(482)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@45c5452a
2015-02-12 11:52:20,302 INFO mapred.MapTask (MapTask.java:runOldMapper(436)) - numReduceTasks: 0
2015-02-12 11:52:20,311 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-12 11:52:20,311 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-12 11:52:20,336 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1051)) - mapred.task.partition is deprecated. Instead, use mapreduce.task.partition
2015-02-12 11:52:20,346 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt"]
2015-02-12 11:52:20,346 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/flowstrategiesplatform/replace"]
2015-02-12 11:52:20,357 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-12 11:52:20,357 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local128435816_0001_m_000000_0 is done. And is in the process of committing
2015-02-12 11:52:20,365 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-12 11:52:20,366 INFO mapred.Task (Task.java:commit(1162)) - Task attempt_local128435816_0001_m_000000_0 is allowed to commit now
2015-02-12 11:52:20,367 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local128435816_0001_m_000000_0' to file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/flowstrategiesplatform/replace/_temporary/0/task_local128435816_0001_m_000000
2015-02-12 11:52:20,369 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt:0+1449
2015-02-12 11:52:20,369 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local128435816_0001_m_000000_0' done.
2015-02-12 11:52:20,369 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local128435816_0001_m_000000_0
2015-02-12 11:52:20,370 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-12 11:52:20,401 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/flowstrategiesplatform/replace/_temporary
2015-02-12 11:52:20,402 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] at least one sink is marked for delete
2015-02-12 11:52:20,403 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] sink oldest modified date: Wed Dec 31 15:59:59 PST 1969
2015-02-12 11:52:20,404 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] at least one sink is marked for delete
2015-02-12 11:52:20,404 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] sink oldest modified date: Wed Dec 31 15:59:59 PST 1969
2015-02-12 11:52:20,440 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 11:52:20,484 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 11:52:20,487 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output//hadoop2-mr1/flowstrategiesplatform/replace
2015-02-12 11:52:20,511 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 11:52:20,512 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 11:52:20,523 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1051)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-12 11:52:20,527 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1051)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-12 11:52:20,528 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1051)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-12 11:52:20,536 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] at least one sink does not exist
2015-02-12 11:52:20,538 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] at least one sink does not exist
2015-02-12 11:52:20,539 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] starting
2015-02-12 11:52:20,539 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt"]
2015-02-12 11:52:20,539 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/flowstrategiesplatform/keep"]
2015-02-12 11:52:20,540 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] parallel execution is enabled: false
2015-02-12 11:52:20,540 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] starting jobs: 1
2015-02-12 11:52:20,540 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] allocating threads: 1
2015-02-12 11:52:20,540 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] starting step: (1/1) ...owstrategiesplatform/keep
2015-02-12 11:52:20,541 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-12 11:52:20,543 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-12 11:52:20,573 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 11:52:20,592 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(494)) - number of splits:1
2015-02-12 11:52:20,615 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(583)) - Submitting tokens for job: job_local2103946553_0002
2015-02-12 11:52:20,699 INFO mapreduce.Job (Job.java:submit(1300)) - The url to track the job: http://localhost:8080/
2015-02-12 11:52:20,699 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-12 11:52:20,699 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] submitted hadoop job: job_local2103946553_0002
2015-02-12 11:52:20,699 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] tracking url: http://localhost:8080/
2015-02-12 11:52:20,699 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-12 11:52:20,702 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-12 11:52:20,702 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local2103946553_0002_m_000000_0
2015-02-12 11:52:20,704 INFO util.ProcfsBasedProcessTree (ProcfsBasedProcessTree.java:isAvailable(181)) - ProcfsBasedProcessTree currently is supported only on Linux.
2015-02-12 11:52:20,704 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : null
2015-02-12 11:52:20,705 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt
2015-02-12 11:52:20,705 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(482)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@7758002b
2015-02-12 11:52:20,706 INFO mapred.MapTask (MapTask.java:runOldMapper(436)) - numReduceTasks: 0
2015-02-12 11:52:20,711 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-12 11:52:20,711 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-12 11:52:20,717 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt"]
2015-02-12 11:52:20,717 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/flowstrategiesplatform/keep"]
2015-02-12 11:52:20,719 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-12 11:52:20,720 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local2103946553_0002_m_000000_0 is done. And is in the process of committing
2015-02-12 11:52:20,721 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-12 11:52:20,721 INFO mapred.Task (Task.java:commit(1162)) - Task attempt_local2103946553_0002_m_000000_0 is allowed to commit now
2015-02-12 11:52:20,721 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local2103946553_0002_m_000000_0' to file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/flowstrategiesplatform/keep/_temporary/0/task_local2103946553_0002_m_000000
2015-02-12 11:52:20,722 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt:0+1449
2015-02-12 11:52:20,722 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local2103946553_0002_m_000000_0' done.
2015-02-12 11:52:20,722 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local2103946553_0002_m_000000_0
2015-02-12 11:52:20,723 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-12 11:52:20,737 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/flowstrategiesplatform/keep/_temporary
2015-02-12 11:52:20,740 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] sink oldest modified date: Thu Feb 12 11:52:20 PST 2015
2015-02-12 11:52:20,743 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] source modification date at: Thu Feb 12 09:42:26 PST 2015
2015-02-12 11:52:20,746 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] sink oldest modified date: Thu Feb 12 11:52:20 PST 2015
2015-02-12 11:52:20,774 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 11:52:20,817 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 11:52:20,818 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output//hadoop2-mr1/flowstrategiesplatform/keep
2015-02-12 11:52:20,844 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 11:52:20,845 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 11:52:20,858 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1051)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-12 11:52:20,861 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1051)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-12 11:52:20,862 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1051)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-12 11:52:20,882 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] starting
2015-02-12 11:52:20,882 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt"]
2015-02-12 11:52:20,882 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/flowstrategiesplatform/simple"]
2015-02-12 11:52:20,883 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] parallel execution is enabled: false
2015-02-12 11:52:20,883 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] starting jobs: 1
2015-02-12 11:52:20,883 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [test] allocating threads: 1
2015-02-12 11:52:20,884 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] starting step: (1/1) ...strategiesplatform/simple
2015-02-12 11:52:20,885 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-12 11:52:20,887 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-02-12 11:52:20,922 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 11:52:20,952 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(494)) - number of splits:1
2015-02-12 11:52:21,037 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(583)) - Submitting tokens for job: job_local339412591_0003
2015-02-12 11:52:21,110 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2015-02-12 11:52:21,110 INFO mapreduce.Job (Job.java:submit(1300)) - The url to track the job: http://localhost:8080/
2015-02-12 11:52:21,110 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2015-02-12 11:52:21,110 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] submitted hadoop job: job_local339412591_0003
2015-02-12 11:52:21,110 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [test] tracking url: http://localhost:8080/
2015-02-12 11:52:21,112 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-02-12 11:52:21,113 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local339412591_0003_m_000000_0
2015-02-12 11:52:21,115 INFO util.ProcfsBasedProcessTree (ProcfsBasedProcessTree.java:isAvailable(181)) - ProcfsBasedProcessTree currently is supported only on Linux.
2015-02-12 11:52:21,115 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : null
2015-02-12 11:52:21,116 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt
2015-02-12 11:52:21,116 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(482)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@23653628
2015-02-12 11:52:21,117 INFO mapred.MapTask (MapTask.java:runOldMapper(436)) - numReduceTasks: 1
2015-02-12 11:52:21,141 INFO mapred.MapTask (MapTask.java:setEquator(1202)) - (EQUATOR) 0 kvi 26214396(104857584)
2015-02-12 11:52:21,141 INFO mapred.MapTask (MapTask.java:init(995)) - mapreduce.task.io.sort.mb: 100
2015-02-12 11:52:21,141 INFO mapred.MapTask (MapTask.java:init(996)) - soft limit at 83886080
2015-02-12 11:52:21,141 INFO mapred.MapTask (MapTask.java:init(997)) - bufstart = 0; bufvoid = 104857600
2015-02-12 11:52:21,142 INFO mapred.MapTask (MapTask.java:init(998)) - kvstart = 26214396; length = 6553600
2015-02-12 11:52:21,159 INFO mapred.MapTask (MapTask.java:createSortingCollector(402)) - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2015-02-12 11:52:21,160 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - cascading version: 2.6.3
2015-02-12 11:52:21,160 INFO hadoop.FlowMapper (FlowMapper.java:configure(72)) - child jvm opts: -Xmx200m
2015-02-12 11:52:21,171 INFO hadoop.FlowMapper (FlowMapper.java:configure(87)) - sourcing from: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt"]
2015-02-12 11:52:21,171 INFO hadoop.FlowMapper (FlowMapper.java:configure(90)) - sinking to: GroupBy(test)[by:[{1}:'ip']]
2015-02-12 11:52:21,174 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2015-02-12 11:52:21,174 INFO mapred.MapTask (MapTask.java:flush(1457)) - Starting flush of map output
2015-02-12 11:52:21,175 INFO mapred.MapTask (MapTask.java:flush(1475)) - Spilling map output
2015-02-12 11:52:21,175 INFO mapred.MapTask (MapTask.java:flush(1476)) - bufstart = 0; bufend = 210; bufvoid = 104857600
2015-02-12 11:52:21,175 INFO mapred.MapTask (MapTask.java:flush(1478)) - kvstart = 26214396(104857584); kvend = 26214360(104857440); length = 37/6553600
2015-02-12 11:52:21,180 INFO mapred.MapTask (MapTask.java:sortAndSpill(1660)) - Finished spill 0
2015-02-12 11:52:21,184 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local339412591_0003_m_000000_0 is done. And is in the process of committing
2015-02-12 11:52:21,185 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/classes/test/data/apache.10.txt:0+1449
2015-02-12 11:52:21,185 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local339412591_0003_m_000000_0' done.
2015-02-12 11:52:21,186 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local339412591_0003_m_000000_0
2015-02-12 11:52:21,186 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-02-12 11:52:21,187 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for reduce tasks
2015-02-12 11:52:21,188 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(302)) - Starting task: attempt_local339412591_0003_r_000000_0
2015-02-12 11:52:21,191 INFO util.ProcfsBasedProcessTree (ProcfsBasedProcessTree.java:isAvailable(181)) - ProcfsBasedProcessTree currently is supported only on Linux.
2015-02-12 11:52:21,192 INFO mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : null
2015-02-12 11:52:21,193 INFO mapred.ReduceTask (ReduceTask.java:run(362)) - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@5a62ee5d
2015-02-12 11:52:21,202 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:<init>(196)) - MergerManager: memoryLimit=493250144, maxSingleShuffleLimit=123312536, mergeThreshold=325545120, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2015-02-12 11:52:21,204 INFO reduce.EventFetcher (EventFetcher.java:run(61)) - attempt_local339412591_0003_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2015-02-12 11:52:21,252 INFO reduce.LocalFetcher (LocalFetcher.java:copyMapOutput(141)) - localfetcher#1 about to shuffle output of map attempt_local339412591_0003_m_000000_0 decomp: 232 len: 236 to MEMORY
2015-02-12 11:52:21,255 INFO reduce.InMemoryMapOutput (InMemoryMapOutput.java:shuffle(100)) - Read 232 bytes from map-output for attempt_local339412591_0003_m_000000_0
2015-02-12 11:52:21,280 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:closeInMemoryFile(314)) - closeInMemoryFile -> map-output of size: 232, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->232
2015-02-12 11:52:21,281 INFO reduce.EventFetcher (EventFetcher.java:run(76)) - EventFetcher is interrupted.. Returning
2015-02-12 11:52:21,282 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-12 11:52:21,282 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(674)) - finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
2015-02-12 11:52:21,286 INFO mapred.Merger (Merger.java:merge(597)) - Merging 1 sorted segments
2015-02-12 11:52:21,286 INFO mapred.Merger (Merger.java:merge(696)) - Down to the last merge-pass, with 1 segments left of total size: 211 bytes
2015-02-12 11:52:21,287 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(751)) - Merged 1 segments, 232 bytes to disk to satisfy reduce memory limit
2015-02-12 11:52:21,287 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(781)) - Merging 1 files, 236 bytes from disk
2015-02-12 11:52:21,288 INFO reduce.MergeManagerImpl (MergeManagerImpl.java:finalMerge(796)) - Merging 0 segments, 0 bytes from memory into reduce
2015-02-12 11:52:21,288 INFO mapred.Merger (Merger.java:merge(597)) - Merging 1 sorted segments
2015-02-12 11:52:21,289 INFO mapred.Merger (Merger.java:merge(696)) - Down to the last merge-pass, with 1 segments left of total size: 211 bytes
2015-02-12 11:52:21,289 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-12 11:52:21,290 INFO hadoop.FlowReducer (FlowReducer.java:configure(78)) - cascading version: 2.6.3
2015-02-12 11:52:21,290 INFO hadoop.FlowReducer (FlowReducer.java:configure(79)) - child jvm opts: -Xmx200m
2015-02-12 11:52:21,298 INFO hadoop.FlowReducer (FlowReducer.java:configure(97)) - sourcing from: GroupBy(test)[by:[{1}:'ip']]
2015-02-12 11:52:21,298 INFO hadoop.FlowReducer (FlowReducer.java:configure(100)) - sinking to: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/flowstrategiesplatform/simple"]
2015-02-12 11:52:21,310 INFO mapred.Task (Task.java:done(1001)) - Task:attempt_local339412591_0003_r_000000_0 is done. And is in the process of committing
2015-02-12 11:52:21,311 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 1 / 1 copied.
2015-02-12 11:52:21,311 INFO mapred.Task (Task.java:commit(1162)) - Task attempt_local339412591_0003_r_000000_0 is allowed to commit now
2015-02-12 11:52:21,312 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local339412591_0003_r_000000_0' to file:/Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/flowstrategiesplatform/simple/_temporary/0/task_local339412591_0003_r_000000
2015-02-12 11:52:21,313 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - reduce > reduce
2015-02-12 11:52:21,313 INFO mapred.Task (Task.java:sendDone(1121)) - Task 'attempt_local339412591_0003_r_000000_0' done.
2015-02-12 11:52:21,314 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(325)) - Finishing task: attempt_local339412591_0003_r_000000_0
2015-02-12 11:52:21,314 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - reduce task executor complete.
2015-02-12 11:52:21,331 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output/hadoop2-mr1/flowstrategiesplatform/simple/_temporary
2015-02-12 11:52:21,357 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 11:52:21,359 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/horton/build/test/output//hadoop2-mr1/flowstrategiesplatform/simple