2014-04-10 11:40:05,784 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(187)) - found 1 test platforms from classpath
2014-04-10 11:40:05,808 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(237)) - installing platform: hadoop2-mr1
2014-04-10 11:40:05,808 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(238)) - running test: cascading.scheme.TextDelimitedPlatformTest
2014-04-10 11:40:05,819 INFO hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(106)) - not using cluster
2014-04-10 11:40:06,096 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2014-04-10 11:40:06,225 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-10 11:40:06,226 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.3/fbde5367797af408c100d25704a77959e50a31d8/cascading-hadoop2-mr1-2.5.3.jar
2014-04-10 11:40:06,231 INFO property.AppProps (AppProps.java:getAppID(162)) - using app.id: EDBB871592A14853A2FAC1572C4D91DA
2014-04-10 11:40:06,263 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-04-10 11:40:06,278 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-04-10 11:40:06,280 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-04-10 11:40:06,325 INFO util.Version (Version.java:printBanner(78)) - Concurrent, Inc - Cascading 2.5.3
2014-04-10 11:40:06,327 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] starting
2014-04-10 11:40:06,328 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited-spec-char.txt"]
2014-04-10 11:40:06,328 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/quoted/speccharfalse"]
2014-04-10 11:40:06,329 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] parallel execution is enabled: false
2014-04-10 11:40:06,329 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] starting jobs: 1
2014-04-10 11:40:06,329 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] allocating threads: 1
2014-04-10 11:40:06,330 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] starting step: (1/1) ...form/quoted/speccharfalse
2014-04-10 11:40:06,348 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - session.id is deprecated. Instead, use dfs.metrics.session-id
2014-04-10 11:40:06,349 INFO jvm.JvmMetrics (JvmMetrics.java:init(76)) - Initializing JVM Metrics with processName=JobTracker, sessionId=
2014-04-10 11:40:06,361 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-04-10 11:40:06,514 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:06,530 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-04-10 11:40:06,626 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1705600397_0001
2014-04-10 11:40:06,647 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/staging/brock1705600397/.staging/job_local1705600397_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2014-04-10 11:40:06,647 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/staging/brock1705600397/.staging/job_local1705600397_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2014-04-10 11:40:06,758 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/local/localRunner/brock/job_local1705600397_0001/job_local1705600397_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2014-04-10 11:40:06,758 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/local/localRunner/brock/job_local1705600397_0001/job_local1705600397_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2014-04-10 11:40:06,764 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-04-10 11:40:06,764 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-04-10 11:40:06,765 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] submitted hadoop job: job_local1705600397_0001
2014-04-10 11:40:06,765 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] tracking url: http://localhost:8080/
2014-04-10 11:40:06,765 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-04-10 11:40:06,794 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-04-10 11:40:06,796 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1705600397_0001_m_000000_0
2014-04-10 11:40:06,812 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2014-04-10 11:40:06,819 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited-spec-char.txt
2014-04-10 11:40:06,819 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@4d2d1f6d
2014-04-10 11:40:06,824 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 0
2014-04-10 11:40:06,831 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-10 11:40:06,831 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-10 11:40:06,847 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.task.partition is deprecated. Instead, use mapreduce.task.partition
2014-04-10 11:40:06,848 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited-spec-char.txt"]
2014-04-10 11:40:06,848 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/quoted/speccharfalse"]
2014-04-10 11:40:06,859 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2014-04-10 11:40:06,859 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1705600397_0001_m_000000_0 is done. And is in the process of committing
2014-04-10 11:40:06,863 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2014-04-10 11:40:06,864 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local1705600397_0001_m_000000_0 is allowed to commit now
2014-04-10 11:40:06,864 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1705600397_0001_m_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/quoted/speccharfalse/_temporary/0/task_local1705600397_0001_m_000000
2014-04-10 11:40:06,865 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited-spec-char.txt:0+197
2014-04-10 11:40:06,865 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1705600397_0001_m_000000_0' done.
2014-04-10 11:40:06,866 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1705600397_0001_m_000000_0
2014-04-10 11:40:06,866 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-04-10 11:40:06,885 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/quoted/speccharfalse/_temporary
2014-04-10 11:40:06,904 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:06,919 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:06,938 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:06,942 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output//hadoop2-mr1/textdelimitedplatform/quoted/speccharfalse
2014-04-10 11:40:06,960 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-10 11:40:06,960 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.3/fbde5367797af408c100d25704a77959e50a31d8/cascading-hadoop2-mr1-2.5.3.jar
2014-04-10 11:40:06,966 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-04-10 11:40:06,969 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-04-10 11:40:06,969 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-04-10 11:40:06,974 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] starting
2014-04-10 11:40:06,974 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] source: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited.txt"]
2014-04-10 11:40:06,975 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] sink: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/quoted/normchartrue"]
2014-04-10 11:40:06,975 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] parallel execution is enabled: false
2014-04-10 11:40:06,975 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] starting jobs: 1
2014-04-10 11:40:06,975 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] allocating threads: 1
2014-04-10 11:40:06,975 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] starting step: (1/1) ...tform/quoted/normchartrue
2014-04-10 11:40:06,976 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-04-10 11:40:06,978 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-04-10 11:40:07,001 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:07,016 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-04-10 11:40:07,044 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1142386124_0002
2014-04-10 11:40:07,055 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/staging/brock1142386124/.staging/job_local1142386124_0002/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2014-04-10 11:40:07,055 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/staging/brock1142386124/.staging/job_local1142386124_0002/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2014-04-10 11:40:07,091 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/local/localRunner/brock/job_local1142386124_0002/job_local1142386124_0002.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2014-04-10 11:40:07,092 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/local/localRunner/brock/job_local1142386124_0002/job_local1142386124_0002.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2014-04-10 11:40:07,092 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-04-10 11:40:07,092 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] submitted hadoop job: job_local1142386124_0002
2014-04-10 11:40:07,092 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-04-10 11:40:07,093 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] tracking url: http://localhost:8080/
2014-04-10 11:40:07,093 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-04-10 11:40:07,094 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-04-10 11:40:07,095 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1142386124_0002_m_000000_0
2014-04-10 11:40:07,096 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2014-04-10 11:40:07,097 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited.txt
2014-04-10 11:40:07,097 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@28454d3e
2014-04-10 11:40:07,099 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 0
2014-04-10 11:40:07,102 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-10 11:40:07,102 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-10 11:40:07,108 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited.txt"]
2014-04-10 11:40:07,108 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/quoted/normchartrue"]
2014-04-10 11:40:07,111 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2014-04-10 11:40:07,111 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1142386124_0002_m_000000_0 is done. And is in the process of committing
2014-04-10 11:40:07,112 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2014-04-10 11:40:07,112 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local1142386124_0002_m_000000_0 is allowed to commit now
2014-04-10 11:40:07,112 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1142386124_0002_m_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/quoted/normchartrue/_temporary/0/task_local1142386124_0002_m_000000
2014-04-10 11:40:07,113 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited.txt:0+198
2014-04-10 11:40:07,113 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1142386124_0002_m_000000_0' done.
2014-04-10 11:40:07,113 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1142386124_0002_m_000000_0
2014-04-10 11:40:07,113 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-04-10 11:40:07,126 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/quoted/normchartrue/_temporary
2014-04-10 11:40:07,142 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:07,156 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:07,173 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:07,175 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output//hadoop2-mr1/textdelimitedplatform/quoted/normchartrue
2014-04-10 11:40:07,189 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-10 11:40:07,190 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.3/fbde5367797af408c100d25704a77959e50a31d8/cascading-hadoop2-mr1-2.5.3.jar
2014-04-10 11:40:07,195 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-04-10 11:40:07,198 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-04-10 11:40:07,198 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-04-10 11:40:07,203 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] starting
2014-04-10 11:40:07,203 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] source: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited-spec-char.txt"]
2014-04-10 11:40:07,203 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] sink: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/quoted/specchartrue"]
2014-04-10 11:40:07,204 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] parallel execution is enabled: false
2014-04-10 11:40:07,204 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] starting jobs: 1
2014-04-10 11:40:07,204 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] allocating threads: 1
2014-04-10 11:40:07,204 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] starting step: (1/1) ...tform/quoted/specchartrue
2014-04-10 11:40:07,204 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-04-10 11:40:07,205 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-04-10 11:40:07,216 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:07,224 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-04-10 11:40:07,245 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1131354830_0003
2014-04-10 11:40:07,256 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/staging/brock1131354830/.staging/job_local1131354830_0003/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2014-04-10 11:40:07,257 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/staging/brock1131354830/.staging/job_local1131354830_0003/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2014-04-10 11:40:07,302 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/local/localRunner/brock/job_local1131354830_0003/job_local1131354830_0003.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2014-04-10 11:40:07,302 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/local/localRunner/brock/job_local1131354830_0003/job_local1131354830_0003.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2014-04-10 11:40:07,304 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-04-10 11:40:07,304 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-04-10 11:40:07,304 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] submitted hadoop job: job_local1131354830_0003
2014-04-10 11:40:07,305 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-04-10 11:40:07,305 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] tracking url: http://localhost:8080/
2014-04-10 11:40:07,306 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-04-10 11:40:07,306 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1131354830_0003_m_000000_0
2014-04-10 11:40:07,308 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2014-04-10 11:40:07,309 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited-spec-char.txt
2014-04-10 11:40:07,309 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@1752c491
2014-04-10 11:40:07,310 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 0
2014-04-10 11:40:07,313 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-10 11:40:07,313 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-10 11:40:07,318 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited-spec-char.txt"]
2014-04-10 11:40:07,318 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/quoted/specchartrue"]
2014-04-10 11:40:07,321 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2014-04-10 11:40:07,321 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1131354830_0003_m_000000_0 is done. And is in the process of committing
2014-04-10 11:40:07,322 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2014-04-10 11:40:07,322 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local1131354830_0003_m_000000_0 is allowed to commit now
2014-04-10 11:40:07,323 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1131354830_0003_m_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/quoted/specchartrue/_temporary/0/task_local1131354830_0003_m_000000
2014-04-10 11:40:07,323 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited-spec-char.txt:0+197
2014-04-10 11:40:07,324 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1131354830_0003_m_000000_0' done.
2014-04-10 11:40:07,324 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1131354830_0003_m_000000_0
2014-04-10 11:40:07,324 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-04-10 11:40:07,339 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/quoted/specchartrue/_temporary
2014-04-10 11:40:07,354 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:07,368 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:07,385 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:07,386 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output//hadoop2-mr1/textdelimitedplatform/quoted/specchartrue
2014-04-10 11:40:07,399 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-10 11:40:07,400 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.3/fbde5367797af408c100d25704a77959e50a31d8/cascading-hadoop2-mr1-2.5.3.jar
2014-04-10 11:40:07,404 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-04-10 11:40:07,407 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-04-10 11:40:07,407 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-04-10 11:40:07,412 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] starting
2014-04-10 11:40:07,412 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited.txt"]
2014-04-10 11:40:07,412 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/headerall"]
2014-04-10 11:40:07,412 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] parallel execution is enabled: false
2014-04-10 11:40:07,412 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] starting jobs: 1
2014-04-10 11:40:07,413 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] allocating threads: 1
2014-04-10 11:40:07,413 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] starting step: (1/1) ...limitedplatform/headerall
2014-04-10 11:40:07,413 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-04-10 11:40:07,414 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-04-10 11:40:07,425 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:07,431 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-04-10 11:40:07,439 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1854530924_0004
2014-04-10 11:40:07,451 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/staging/brock1854530924/.staging/job_local1854530924_0004/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2014-04-10 11:40:07,451 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/staging/brock1854530924/.staging/job_local1854530924_0004/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2014-04-10 11:40:07,485 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/local/localRunner/brock/job_local1854530924_0004/job_local1854530924_0004.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2014-04-10 11:40:07,486 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/local/localRunner/brock/job_local1854530924_0004/job_local1854530924_0004.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2014-04-10 11:40:07,486 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-04-10 11:40:07,487 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] submitted hadoop job: job_local1854530924_0004
2014-04-10 11:40:07,487 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] tracking url: http://localhost:8080/
2014-04-10 11:40:07,487 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-04-10 11:40:07,487 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-04-10 11:40:07,489 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-04-10 11:40:07,489 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1854530924_0004_m_000000_0
2014-04-10 11:40:07,490 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2014-04-10 11:40:07,491 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited.txt
2014-04-10 11:40:07,491 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@39ef77c2
2014-04-10 11:40:07,492 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 0
2014-04-10 11:40:07,495 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-10 11:40:07,496 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-10 11:40:07,502 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited.txt"]
2014-04-10 11:40:07,502 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/headerall"]
2014-04-10 11:40:07,508 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2014-04-10 11:40:07,508 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1854530924_0004_m_000000_0 is done. And is in the process of committing
2014-04-10 11:40:07,509 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2014-04-10 11:40:07,509 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local1854530924_0004_m_000000_0 is allowed to commit now
2014-04-10 11:40:07,510 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1854530924_0004_m_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/headerall/_temporary/0/task_local1854530924_0004_m_000000
2014-04-10 11:40:07,510 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited.txt:0+198
2014-04-10 11:40:07,510 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1854530924_0004_m_000000_0' done.
2014-04-10 11:40:07,511 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1854530924_0004_m_000000_0
2014-04-10 11:40:07,511 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-04-10 11:40:07,530 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/headerall/_temporary
2014-04-10 11:40:07,548 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:07,550 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output//hadoop2-mr1/textdelimitedplatform/headerall
2014-04-10 11:40:07,562 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-10 11:40:07,563 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.3/fbde5367797af408c100d25704a77959e50a31d8/cascading-hadoop2-mr1-2.5.3.jar
2014-04-10 11:40:07,566 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-04-10 11:40:07,568 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-04-10 11:40:07,568 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-04-10 11:40:07,572 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] starting
2014-04-10 11:40:07,572 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited.txt"]
2014-04-10 11:40:07,572 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/quoted/normcharfalse"]
2014-04-10 11:40:07,573 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] parallel execution is enabled: false
2014-04-10 11:40:07,573 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] starting jobs: 1
2014-04-10 11:40:07,573 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] allocating threads: 1
2014-04-10 11:40:07,573 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] starting step: (1/1) ...form/quoted/normcharfalse
2014-04-10 11:40:07,574 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-04-10 11:40:07,575 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-04-10 11:40:07,594 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:07,607 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-04-10 11:40:07,627 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local2066590125_0005
2014-04-10 11:40:07,636 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/staging/brock2066590125/.staging/job_local2066590125_0005/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2014-04-10 11:40:07,636 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/staging/brock2066590125/.staging/job_local2066590125_0005/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2014-04-10 11:40:07,660 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/local/localRunner/brock/job_local2066590125_0005/job_local2066590125_0005.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2014-04-10 11:40:07,660 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/local/localRunner/brock/job_local2066590125_0005/job_local2066590125_0005.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2014-04-10 11:40:07,661 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-04-10 11:40:07,661 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-04-10 11:40:07,661 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] submitted hadoop job: job_local2066590125_0005
2014-04-10 11:40:07,661 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-04-10 11:40:07,661 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] tracking url: http://localhost:8080/
2014-04-10 11:40:07,664 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-04-10 11:40:07,664 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local2066590125_0005_m_000000_0
2014-04-10 11:40:07,667 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2014-04-10 11:40:07,668 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited.txt
2014-04-10 11:40:07,668 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@2d13b5e4
2014-04-10 11:40:07,670 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 0
2014-04-10 11:40:07,676 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-10 11:40:07,677 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-10 11:40:07,686 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited.txt"]
2014-04-10 11:40:07,687 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/quoted/normcharfalse"]
2014-04-10 11:40:07,690 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2014-04-10 11:40:07,690 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local2066590125_0005_m_000000_0 is done. And is in the process of committing
2014-04-10 11:40:07,691 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2014-04-10 11:40:07,692 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local2066590125_0005_m_000000_0 is allowed to commit now
2014-04-10 11:40:07,692 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local2066590125_0005_m_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/quoted/normcharfalse/_temporary/0/task_local2066590125_0005_m_000000
2014-04-10 11:40:07,693 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited.txt:0+198
2014-04-10 11:40:07,693 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local2066590125_0005_m_000000_0' done.
2014-04-10 11:40:07,693 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local2066590125_0005_m_000000_0
2014-04-10 11:40:07,693 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-04-10 11:40:07,707 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/quoted/normcharfalse/_temporary
2014-04-10 11:40:07,727 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:07,743 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:07,757 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:07,759 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output//hadoop2-mr1/textdelimitedplatform/quoted/normcharfalse
2014-04-10 11:40:07,831 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-10 11:40:07,831 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.3/fbde5367797af408c100d25704a77959e50a31d8/cascading-hadoop2-mr1-2.5.3.jar
2014-04-10 11:40:07,835 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-04-10 11:40:07,844 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-04-10 11:40:07,845 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-04-10 11:40:07,857 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] starting
2014-04-10 11:40:07,858 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] source: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z'}, String, int, long, String, String, String]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/apache-clean.10.txt"]
2014-04-10 11:40:07,858 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] sink: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z'}, String, int, long, String, String, String]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/testFieldCoercion"]
2014-04-10 11:40:07,858 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] parallel execution is enabled: false
2014-04-10 11:40:07,858 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] starting jobs: 1
2014-04-10 11:40:07,858 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] allocating threads: 1
2014-04-10 11:40:07,858 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] starting step: (1/1) ...latform/testFieldCoercion
2014-04-10 11:40:07,859 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-04-10 11:40:07,859 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-04-10 11:40:07,878 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:07,890 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-04-10 11:40:07,896 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1266926718_0006
2014-04-10 11:40:07,906 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/staging/brock1266926718/.staging/job_local1266926718_0006/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2014-04-10 11:40:07,907 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/staging/brock1266926718/.staging/job_local1266926718_0006/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2014-04-10 11:40:07,930 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/local/localRunner/brock/job_local1266926718_0006/job_local1266926718_0006.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2014-04-10 11:40:07,930 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/local/localRunner/brock/job_local1266926718_0006/job_local1266926718_0006.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2014-04-10 11:40:07,931 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-04-10 11:40:07,931 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-04-10 11:40:07,931 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] submitted hadoop job: job_local1266926718_0006
2014-04-10 11:40:07,931 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] tracking url: http://localhost:8080/
2014-04-10 11:40:07,931 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-04-10 11:40:07,934 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-04-10 11:40:07,934 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1266926718_0006_m_000000_0
2014-04-10 11:40:07,936 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2014-04-10 11:40:07,938 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/apache-clean.10.txt
2014-04-10 11:40:07,938 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@4258426
2014-04-10 11:40:07,940 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 0
2014-04-10 11:40:07,946 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-10 11:40:07,946 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-10 11:40:07,963 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z'}, String, int, long, String, String, String]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/apache-clean.10.txt"]
2014-04-10 11:40:07,963 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z'}, String, int, long, String, String, String]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/testFieldCoercion"]
2014-04-10 11:40:08,013 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2014-04-10 11:40:08,013 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1266926718_0006_m_000000_0 is done. And is in the process of committing
2014-04-10 11:40:08,014 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2014-04-10 11:40:08,014 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local1266926718_0006_m_000000_0 is allowed to commit now
2014-04-10 11:40:08,015 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1266926718_0006_m_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/testFieldCoercion/_temporary/0/task_local1266926718_0006_m_000000
2014-04-10 11:40:08,016 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/apache-clean.10.txt:0+1449
2014-04-10 11:40:08,016 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1266926718_0006_m_000000_0' done.
2014-04-10 11:40:08,016 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1266926718_0006_m_000000_0
2014-04-10 11:40:08,016 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-04-10 11:40:08,027 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/testFieldCoercion/_temporary
2014-04-10 11:40:08,041 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:08,044 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output//hadoop2-mr1/textdelimitedplatform/testFieldCoercion
2014-04-10 11:40:08,055 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-10 11:40:08,055 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.3/fbde5367797af408c100d25704a77959e50a31d8/cascading-hadoop2-mr1-2.5.3.jar
2014-04-10 11:40:08,065 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:08,070 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-04-10 11:40:08,071 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-04-10 11:40:08,072 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-04-10 11:40:08,079 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] starting
2014-04-10 11:40:08,080 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited-header.txt"]
2014-04-10 11:40:08,080 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] sink: MultiSinkTap[[Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/headerfieldsall1"], Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/headerfieldsall2"]]]
2014-04-10 11:40:08,080 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] parallel execution is enabled: false
2014-04-10 11:40:08,080 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] starting jobs: 1
2014-04-10 11:40:08,080 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] allocating threads: 1
2014-04-10 11:40:08,080 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] starting step: (1/1) ...FCF7C480783E41CCB5C20CE02
2014-04-10 11:40:08,081 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-04-10 11:40:08,082 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-04-10 11:40:08,095 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:08,104 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-04-10 11:40:08,116 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local80434576_0007
2014-04-10 11:40:08,131 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/staging/brock80434576/.staging/job_local80434576_0007/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2014-04-10 11:40:08,131 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/staging/brock80434576/.staging/job_local80434576_0007/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2014-04-10 11:40:08,158 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/local/localRunner/brock/job_local80434576_0007/job_local80434576_0007.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2014-04-10 11:40:08,158 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/local/localRunner/brock/job_local80434576_0007/job_local80434576_0007.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2014-04-10 11:40:08,159 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-04-10 11:40:08,159 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] submitted hadoop job: job_local80434576_0007
2014-04-10 11:40:08,159 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] tracking url: http://localhost:8080/
2014-04-10 11:40:08,159 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-04-10 11:40:08,159 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-04-10 11:40:08,161 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-04-10 11:40:08,162 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local80434576_0007_m_000000_0
2014-04-10 11:40:08,164 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2014-04-10 11:40:08,165 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited-header.txt
2014-04-10 11:40:08,165 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@a16d286
2014-04-10 11:40:08,167 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 0
2014-04-10 11:40:08,168 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-10 11:40:08,168 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-10 11:40:08,177 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited-header.txt"]
2014-04-10 11:40:08,178 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: MultiSinkTap[[Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/headerfieldsall1"], Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/headerfieldsall2"]]]
2014-04-10 11:40:08,179 INFO tap.MultiSinkTap (MultiSinkTap.java:<init>(80)) - opening for write: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/headerfieldsall1"]
2014-04-10 11:40:08,180 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id
2014-04-10 11:40:08,180 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.work.output.dir is deprecated. Instead, use mapreduce.task.output.dir
2014-04-10 11:40:08,180 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:setupTask(98)) - setting up task: 'attempt_local80434576_0007_m_000000_0' - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/headerfieldsall1/_temporary/_attempt_local80434576_0007_m_000000_0
2014-04-10 11:40:08,180 INFO io.TapOutputCollector (TapOutputCollector.java:initialize(112)) - creating path: part-00000
2014-04-10 11:40:08,184 INFO tap.MultiSinkTap (MultiSinkTap.java:<init>(80)) - opening for write: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/headerfieldsall2"]
2014-04-10 11:40:08,186 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:setupTask(98)) - setting up task: 'attempt_local80434576_0007_m_000000_0' - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/headerfieldsall2/_temporary/_attempt_local80434576_0007_m_000000_0
2014-04-10 11:40:08,186 INFO io.TapOutputCollector (TapOutputCollector.java:initialize(112)) - creating path: part-00000
2014-04-10 11:40:08,193 INFO io.TapOutputCollector (TapOutputCollector.java:close(135)) - closing tap collector for: /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/headerfieldsall1/part-00000
2014-04-10 11:40:08,193 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(155)) - committing task: 'attempt_local80434576_0007_m_000000_0' - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/headerfieldsall1/_temporary/_attempt_local80434576_0007_m_000000_0
2014-04-10 11:40:08,194 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(172)) - saved output of task 'attempt_local80434576_0007_m_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/headerfieldsall1
2014-04-10 11:40:08,194 INFO io.TapOutputCollector (TapOutputCollector.java:close(135)) - closing tap collector for: /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/headerfieldsall2/part-00000
2014-04-10 11:40:08,195 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(155)) - committing task: 'attempt_local80434576_0007_m_000000_0' - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/headerfieldsall2/_temporary/_attempt_local80434576_0007_m_000000_0
2014-04-10 11:40:08,196 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(172)) - saved output of task 'attempt_local80434576_0007_m_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/headerfieldsall2
2014-04-10 11:40:08,197 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2014-04-10 11:40:08,197 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local80434576_0007_m_000000_0 is done. And is in the process of committing
2014-04-10 11:40:08,198 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited-header.txt:0+244
2014-04-10 11:40:08,198 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local80434576_0007_m_000000_0' done.
2014-04-10 11:40:08,198 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local80434576_0007_m_000000_0
2014-04-10 11:40:08,198 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-04-10 11:40:08,234 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:08,252 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:08,276 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:08,277 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output//hadoop2-mr1/textdelimitedplatform/headerfieldsall1
2014-04-10 11:40:08,277 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output//hadoop2-mr1/textdelimitedplatform/headerfieldsall2
2014-04-10 11:40:08,290 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-10 11:40:08,290 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.3/fbde5367797af408c100d25704a77959e50a31d8/cascading-hadoop2-mr1-2.5.3.jar
2014-04-10 11:40:08,293 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-04-10 11:40:08,295 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-04-10 11:40:08,298 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] starting
2014-04-10 11:40:08,299 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited.txt"]
2014-04-10 11:40:08,299 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/header"]
2014-04-10 11:40:08,299 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] parallel execution is enabled: false
2014-04-10 11:40:08,299 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] starting jobs: 1
2014-04-10 11:40:08,299 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] allocating threads: 1
2014-04-10 11:40:08,300 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] starting step: (1/1) ...tdelimitedplatform/header
2014-04-10 11:40:08,300 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-04-10 11:40:08,302 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-04-10 11:40:08,318 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:08,330 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-04-10 11:40:08,343 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1289291334_0008
2014-04-10 11:40:08,355 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/staging/brock1289291334/.staging/job_local1289291334_0008/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2014-04-10 11:40:08,355 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/staging/brock1289291334/.staging/job_local1289291334_0008/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2014-04-10 11:40:08,388 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/local/localRunner/brock/job_local1289291334_0008/job_local1289291334_0008.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2014-04-10 11:40:08,388 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/local/localRunner/brock/job_local1289291334_0008/job_local1289291334_0008.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2014-04-10 11:40:08,389 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-04-10 11:40:08,389 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-04-10 11:40:08,390 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] submitted hadoop job: job_local1289291334_0008
2014-04-10 11:40:08,390 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-04-10 11:40:08,390 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] tracking url: http://localhost:8080/
2014-04-10 11:40:08,392 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-04-10 11:40:08,393 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1289291334_0008_m_000000_0
2014-04-10 11:40:08,395 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2014-04-10 11:40:08,396 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited.txt
2014-04-10 11:40:08,397 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@2daf73a4
2014-04-10 11:40:08,398 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 0
2014-04-10 11:40:08,404 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-10 11:40:08,404 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-10 11:40:08,413 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited.txt"]
2014-04-10 11:40:08,413 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/header"]
2014-04-10 11:40:08,419 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2014-04-10 11:40:08,419 INFO mapred.Task (Task.java:done(995)) - Task:attempt_local1289291334_0008_m_000000_0 is done. And is in the process of committing
2014-04-10 11:40:08,420 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) -
2014-04-10 11:40:08,420 INFO mapred.Task (Task.java:commit(1156)) - Task attempt_local1289291334_0008_m_000000_0 is allowed to commit now
2014-04-10 11:40:08,420 INFO output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1289291334_0008_m_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/header/_temporary/0/task_local1289291334_0008_m_000000
2014-04-10 11:40:08,421 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited.txt:0+198
2014-04-10 11:40:08,421 INFO mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1289291334_0008_m_000000_0' done.
2014-04-10 11:40:08,421 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1289291334_0008_m_000000_0
2014-04-10 11:40:08,421 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-04-10 11:40:08,436 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/header/_temporary
2014-04-10 11:40:08,454 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:08,456 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output//hadoop2-mr1/textdelimitedplatform/header
2014-04-10 11:40:08,471 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-10 11:40:08,471 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.3/fbde5367797af408c100d25704a77959e50a31d8/cascading-hadoop2-mr1-2.5.3.jar
2014-04-10 11:40:08,474 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-04-10 11:40:08,476 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-04-10 11:40:08,476 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-04-10 11:40:08,479 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] starting
2014-04-10 11:40:08,480 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited-extra-field.txt"]
2014-04-10 11:40:08,480 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/strict-nondeterministic"]
2014-04-10 11:40:08,480 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] parallel execution is enabled: false
2014-04-10 11:40:08,480 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] starting jobs: 1
2014-04-10 11:40:08,480 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] allocating threads: 1
2014-04-10 11:40:08,480 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] starting step: (1/1) ...m/strict-nondeterministic
2014-04-10 11:40:08,480 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-04-10 11:40:08,481 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-04-10 11:40:08,489 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:08,495 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-04-10 11:40:08,502 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local189027121_0009
2014-04-10 11:40:08,513 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/staging/brock189027121/.staging/job_local189027121_0009/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2014-04-10 11:40:08,513 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/staging/brock189027121/.staging/job_local189027121_0009/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2014-04-10 11:40:08,535 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/local/localRunner/brock/job_local189027121_0009/job_local189027121_0009.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2014-04-10 11:40:08,536 WARN conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/local/localRunner/brock/job_local189027121_0009/job_local189027121_0009.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2014-04-10 11:40:08,536 INFO mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-04-10 11:40:08,536 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-04-10 11:40:08,536 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] submitted hadoop job: job_local189027121_0009
2014-04-10 11:40:08,537 INFO mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-04-10 11:40:08,537 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] tracking url: http://localhost:8080/
2014-04-10 11:40:08,539 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-04-10 11:40:08,540 INFO mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local189027121_0009_m_000000_0
2014-04-10 11:40:08,542 INFO mapred.Task (Task.java:initialize(581)) - Using ResourceCalculatorProcessTree : [ ]
2014-04-10 11:40:08,543 INFO io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited-extra-field.txt
2014-04-10 11:40:08,543 INFO mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@7ff7709b
2014-04-10 11:40:08,545 INFO mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 0
2014-04-10 11:40:08,550 INFO hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-10 11:40:08,550 INFO hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-10 11:40:08,558 INFO hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited-extra-field.txt"]
2014-04-10 11:40:08,558 INFO hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/strict-nondeterministic"]
2014-04-10 11:40:08,560 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: unable to read from input identifier: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited-extra-field.txt
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:127)
at cascading.flow.stream.SourceStage.map(SourceStage.java:76)
at cascading.flow.stream.SourceStage.run(SourceStage.java:58)
at cascading.flow.hadoop.FlowMapper.run(FlowMapper.java:127)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:430)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:342)
at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1008)
at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:140)
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:120)
... 12 more
2014-04-10 11:40:08,562 ERROR stream.SourceStage (SourceStage.java:map(110)) - caught throwable
cascading.tuple.TupleException: unable to read from input identifier: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited-extra-field.txt
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:127)
at cascading.flow.stream.SourceStage.map(SourceStage.java:76)
at cascading.flow.stream.SourceStage.run(SourceStage.java:58)
at cascading.flow.hadoop.FlowMapper.run(FlowMapper.java:127)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:430)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:342)
at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1008)
at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:140)
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:120)
... 12 more
2014-04-10 11:40:08,562 INFO mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-04-10 11:40:08,565 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local189027121_0009
java.lang.Exception: cascading.tuple.TupleException: unable to read from input identifier: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited-extra-field.txt
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
Caused by: cascading.tuple.TupleException: unable to read from input identifier: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited-extra-field.txt
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:127)
at cascading.flow.stream.SourceStage.map(SourceStage.java:76)
at cascading.flow.stream.SourceStage.run(SourceStage.java:58)
at cascading.flow.hadoop.FlowMapper.run(FlowMapper.java:127)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:430)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:342)
at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1008)
at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:140)
at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:120)
... 12 more
2014-04-10 11:40:08,568 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [pipe] hadoop job job_local189027121_0009 state at FAILED
2014-04-10 11:40:08,568 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [pipe] failure info: NA
2014-04-10 11:40:08,569 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [pipe] task completion events identify failed tasks
2014-04-10 11:40:08,569 WARN flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [pipe] task completion events count: 0
2014-04-10 11:40:08,570 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] stopping all jobs
2014-04-10 11:40:08,570 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] stopping: (1/1) ...m/strict-nondeterministic
2014-04-10 11:40:08,570 INFO flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] stopped all jobs
2014-04-10 11:40:08,570 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/strict-nondeterministic/_temporary
2014-04-10 11:40:08,570 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output//hadoop2-mr1/textdelimitedplatform/strict-nondeterministic