Class cascading.scheme.TextDelimitedPlatformTest

9

tests

0

failures

0

ignored

2.750s

duration

100%

successful

Tests

Test Duration Result
testFieldCoercion 0.284s passed
testHeader 0.178s passed
testHeaderAll 0.163s passed
testHeaderFieldsAll 0.233s passed
testQuotedText 0.210s passed
testQuotedTextAll 0.230s passed
testQuotedTextSpecChar 1.125s passed
testQuotedTextSpecCharAll 0.212s passed
testStrict 0.115s passed

Standard output

2014-04-10 11:40:05,784 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(187)) - found 1 test platforms from classpath
2014-04-10 11:40:05,808 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(237)) - installing platform: hadoop2-mr1
2014-04-10 11:40:05,808 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(238)) - running test: cascading.scheme.TextDelimitedPlatformTest
2014-04-10 11:40:05,819 INFO  hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(106)) - not using cluster
2014-04-10 11:40:06,096 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2014-04-10 11:40:06,225 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-10 11:40:06,226 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.3/fbde5367797af408c100d25704a77959e50a31d8/cascading-hadoop2-mr1-2.5.3.jar
2014-04-10 11:40:06,231 INFO  property.AppProps (AppProps.java:getAppID(162)) - using app.id: EDBB871592A14853A2FAC1572C4D91DA
2014-04-10 11:40:06,263 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-04-10 11:40:06,278 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-04-10 11:40:06,280 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-04-10 11:40:06,325 INFO  util.Version (Version.java:printBanner(78)) - Concurrent, Inc - Cascading 2.5.3
2014-04-10 11:40:06,327 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] starting
2014-04-10 11:40:06,328 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited-spec-char.txt"]
2014-04-10 11:40:06,328 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/quoted/speccharfalse"]
2014-04-10 11:40:06,329 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  parallel execution is enabled: false
2014-04-10 11:40:06,329 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  starting jobs: 1
2014-04-10 11:40:06,329 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  allocating threads: 1
2014-04-10 11:40:06,330 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] starting step: (1/1) ...form/quoted/speccharfalse
2014-04-10 11:40:06,348 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - session.id is deprecated. Instead, use dfs.metrics.session-id
2014-04-10 11:40:06,349 INFO  jvm.JvmMetrics (JvmMetrics.java:init(76)) - Initializing JVM Metrics with processName=JobTracker, sessionId=
2014-04-10 11:40:06,361 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-04-10 11:40:06,514 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:06,530 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-04-10 11:40:06,626 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1705600397_0001
2014-04-10 11:40:06,647 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/staging/brock1705600397/.staging/job_local1705600397_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-04-10 11:40:06,647 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/staging/brock1705600397/.staging/job_local1705600397_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-04-10 11:40:06,758 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/local/localRunner/brock/job_local1705600397_0001/job_local1705600397_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-04-10 11:40:06,758 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/local/localRunner/brock/job_local1705600397_0001/job_local1705600397_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-04-10 11:40:06,764 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-04-10 11:40:06,764 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-04-10 11:40:06,765 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] submitted hadoop job: job_local1705600397_0001
2014-04-10 11:40:06,765 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] tracking url: http://localhost:8080/
2014-04-10 11:40:06,765 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-04-10 11:40:06,794 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-04-10 11:40:06,796 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1705600397_0001_m_000000_0
2014-04-10 11:40:06,812 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-04-10 11:40:06,819 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited-spec-char.txt
2014-04-10 11:40:06,819 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@4d2d1f6d
2014-04-10 11:40:06,824 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 0
2014-04-10 11:40:06,831 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-10 11:40:06,831 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-10 11:40:06,847 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.task.partition is deprecated. Instead, use mapreduce.task.partition
2014-04-10 11:40:06,848 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited-spec-char.txt"]
2014-04-10 11:40:06,848 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/quoted/speccharfalse"]
2014-04-10 11:40:06,859 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2014-04-10 11:40:06,859 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1705600397_0001_m_000000_0 is done. And is in the process of committing
2014-04-10 11:40:06,863 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2014-04-10 11:40:06,864 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local1705600397_0001_m_000000_0 is allowed to commit now
2014-04-10 11:40:06,864 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1705600397_0001_m_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/quoted/speccharfalse/_temporary/0/task_local1705600397_0001_m_000000
2014-04-10 11:40:06,865 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited-spec-char.txt:0+197
2014-04-10 11:40:06,865 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1705600397_0001_m_000000_0' done.
2014-04-10 11:40:06,866 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1705600397_0001_m_000000_0
2014-04-10 11:40:06,866 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-04-10 11:40:06,885 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/quoted/speccharfalse/_temporary
2014-04-10 11:40:06,904 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:06,919 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:06,938 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:06,942 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output//hadoop2-mr1/textdelimitedplatform/quoted/speccharfalse
2014-04-10 11:40:06,960 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-10 11:40:06,960 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.3/fbde5367797af408c100d25704a77959e50a31d8/cascading-hadoop2-mr1-2.5.3.jar
2014-04-10 11:40:06,966 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-04-10 11:40:06,969 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-04-10 11:40:06,969 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-04-10 11:40:06,974 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] starting
2014-04-10 11:40:06,974 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  source: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited.txt"]
2014-04-10 11:40:06,975 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  sink: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/quoted/normchartrue"]
2014-04-10 11:40:06,975 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  parallel execution is enabled: false
2014-04-10 11:40:06,975 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  starting jobs: 1
2014-04-10 11:40:06,975 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  allocating threads: 1
2014-04-10 11:40:06,975 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] starting step: (1/1) ...tform/quoted/normchartrue
2014-04-10 11:40:06,976 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-04-10 11:40:06,978 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-04-10 11:40:07,001 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:07,016 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-04-10 11:40:07,044 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1142386124_0002
2014-04-10 11:40:07,055 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/staging/brock1142386124/.staging/job_local1142386124_0002/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-04-10 11:40:07,055 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/staging/brock1142386124/.staging/job_local1142386124_0002/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-04-10 11:40:07,091 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/local/localRunner/brock/job_local1142386124_0002/job_local1142386124_0002.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-04-10 11:40:07,092 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/local/localRunner/brock/job_local1142386124_0002/job_local1142386124_0002.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-04-10 11:40:07,092 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-04-10 11:40:07,092 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] submitted hadoop job: job_local1142386124_0002
2014-04-10 11:40:07,092 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-04-10 11:40:07,093 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] tracking url: http://localhost:8080/
2014-04-10 11:40:07,093 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-04-10 11:40:07,094 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-04-10 11:40:07,095 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1142386124_0002_m_000000_0
2014-04-10 11:40:07,096 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-04-10 11:40:07,097 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited.txt
2014-04-10 11:40:07,097 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@28454d3e
2014-04-10 11:40:07,099 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 0
2014-04-10 11:40:07,102 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-10 11:40:07,102 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-10 11:40:07,108 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited.txt"]
2014-04-10 11:40:07,108 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/quoted/normchartrue"]
2014-04-10 11:40:07,111 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2014-04-10 11:40:07,111 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1142386124_0002_m_000000_0 is done. And is in the process of committing
2014-04-10 11:40:07,112 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2014-04-10 11:40:07,112 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local1142386124_0002_m_000000_0 is allowed to commit now
2014-04-10 11:40:07,112 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1142386124_0002_m_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/quoted/normchartrue/_temporary/0/task_local1142386124_0002_m_000000
2014-04-10 11:40:07,113 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited.txt:0+198
2014-04-10 11:40:07,113 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1142386124_0002_m_000000_0' done.
2014-04-10 11:40:07,113 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1142386124_0002_m_000000_0
2014-04-10 11:40:07,113 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-04-10 11:40:07,126 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/quoted/normchartrue/_temporary
2014-04-10 11:40:07,142 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:07,156 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:07,173 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:07,175 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output//hadoop2-mr1/textdelimitedplatform/quoted/normchartrue
2014-04-10 11:40:07,189 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-10 11:40:07,190 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.3/fbde5367797af408c100d25704a77959e50a31d8/cascading-hadoop2-mr1-2.5.3.jar
2014-04-10 11:40:07,195 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-04-10 11:40:07,198 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-04-10 11:40:07,198 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-04-10 11:40:07,203 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] starting
2014-04-10 11:40:07,203 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  source: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited-spec-char.txt"]
2014-04-10 11:40:07,203 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  sink: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/quoted/specchartrue"]
2014-04-10 11:40:07,204 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  parallel execution is enabled: false
2014-04-10 11:40:07,204 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  starting jobs: 1
2014-04-10 11:40:07,204 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  allocating threads: 1
2014-04-10 11:40:07,204 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] starting step: (1/1) ...tform/quoted/specchartrue
2014-04-10 11:40:07,204 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-04-10 11:40:07,205 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-04-10 11:40:07,216 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:07,224 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-04-10 11:40:07,245 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1131354830_0003
2014-04-10 11:40:07,256 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/staging/brock1131354830/.staging/job_local1131354830_0003/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-04-10 11:40:07,257 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/staging/brock1131354830/.staging/job_local1131354830_0003/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-04-10 11:40:07,302 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/local/localRunner/brock/job_local1131354830_0003/job_local1131354830_0003.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-04-10 11:40:07,302 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/local/localRunner/brock/job_local1131354830_0003/job_local1131354830_0003.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-04-10 11:40:07,304 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-04-10 11:40:07,304 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-04-10 11:40:07,304 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] submitted hadoop job: job_local1131354830_0003
2014-04-10 11:40:07,305 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-04-10 11:40:07,305 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] tracking url: http://localhost:8080/
2014-04-10 11:40:07,306 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-04-10 11:40:07,306 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1131354830_0003_m_000000_0
2014-04-10 11:40:07,308 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-04-10 11:40:07,309 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited-spec-char.txt
2014-04-10 11:40:07,309 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@1752c491
2014-04-10 11:40:07,310 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 0
2014-04-10 11:40:07,313 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-10 11:40:07,313 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-10 11:40:07,318 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited-spec-char.txt"]
2014-04-10 11:40:07,318 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: Hfs["TextDelimited[[UNKNOWN]->[ALL]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/quoted/specchartrue"]
2014-04-10 11:40:07,321 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2014-04-10 11:40:07,321 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1131354830_0003_m_000000_0 is done. And is in the process of committing
2014-04-10 11:40:07,322 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2014-04-10 11:40:07,322 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local1131354830_0003_m_000000_0 is allowed to commit now
2014-04-10 11:40:07,323 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1131354830_0003_m_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/quoted/specchartrue/_temporary/0/task_local1131354830_0003_m_000000
2014-04-10 11:40:07,323 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited-spec-char.txt:0+197
2014-04-10 11:40:07,324 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1131354830_0003_m_000000_0' done.
2014-04-10 11:40:07,324 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1131354830_0003_m_000000_0
2014-04-10 11:40:07,324 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-04-10 11:40:07,339 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/quoted/specchartrue/_temporary
2014-04-10 11:40:07,354 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:07,368 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:07,385 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:07,386 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output//hadoop2-mr1/textdelimitedplatform/quoted/specchartrue
2014-04-10 11:40:07,399 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-10 11:40:07,400 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.3/fbde5367797af408c100d25704a77959e50a31d8/cascading-hadoop2-mr1-2.5.3.jar
2014-04-10 11:40:07,404 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-04-10 11:40:07,407 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-04-10 11:40:07,407 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-04-10 11:40:07,412 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] starting
2014-04-10 11:40:07,412 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited.txt"]
2014-04-10 11:40:07,412 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/headerall"]
2014-04-10 11:40:07,412 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  parallel execution is enabled: false
2014-04-10 11:40:07,412 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  starting jobs: 1
2014-04-10 11:40:07,413 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  allocating threads: 1
2014-04-10 11:40:07,413 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] starting step: (1/1) ...limitedplatform/headerall
2014-04-10 11:40:07,413 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-04-10 11:40:07,414 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-04-10 11:40:07,425 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:07,431 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-04-10 11:40:07,439 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1854530924_0004
2014-04-10 11:40:07,451 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/staging/brock1854530924/.staging/job_local1854530924_0004/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-04-10 11:40:07,451 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/staging/brock1854530924/.staging/job_local1854530924_0004/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-04-10 11:40:07,485 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/local/localRunner/brock/job_local1854530924_0004/job_local1854530924_0004.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-04-10 11:40:07,486 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/local/localRunner/brock/job_local1854530924_0004/job_local1854530924_0004.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-04-10 11:40:07,486 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-04-10 11:40:07,487 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] submitted hadoop job: job_local1854530924_0004
2014-04-10 11:40:07,487 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] tracking url: http://localhost:8080/
2014-04-10 11:40:07,487 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-04-10 11:40:07,487 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-04-10 11:40:07,489 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-04-10 11:40:07,489 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1854530924_0004_m_000000_0
2014-04-10 11:40:07,490 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-04-10 11:40:07,491 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited.txt
2014-04-10 11:40:07,491 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@39ef77c2
2014-04-10 11:40:07,492 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 0
2014-04-10 11:40:07,495 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-10 11:40:07,496 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-10 11:40:07,502 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited.txt"]
2014-04-10 11:40:07,502 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/headerall"]
2014-04-10 11:40:07,508 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2014-04-10 11:40:07,508 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1854530924_0004_m_000000_0 is done. And is in the process of committing
2014-04-10 11:40:07,509 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2014-04-10 11:40:07,509 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local1854530924_0004_m_000000_0 is allowed to commit now
2014-04-10 11:40:07,510 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1854530924_0004_m_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/headerall/_temporary/0/task_local1854530924_0004_m_000000
2014-04-10 11:40:07,510 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited.txt:0+198
2014-04-10 11:40:07,510 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1854530924_0004_m_000000_0' done.
2014-04-10 11:40:07,511 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1854530924_0004_m_000000_0
2014-04-10 11:40:07,511 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-04-10 11:40:07,530 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/headerall/_temporary
2014-04-10 11:40:07,548 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:07,550 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output//hadoop2-mr1/textdelimitedplatform/headerall
2014-04-10 11:40:07,562 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-10 11:40:07,563 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.3/fbde5367797af408c100d25704a77959e50a31d8/cascading-hadoop2-mr1-2.5.3.jar
2014-04-10 11:40:07,566 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-04-10 11:40:07,568 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-04-10 11:40:07,568 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-04-10 11:40:07,572 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] starting
2014-04-10 11:40:07,572 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited.txt"]
2014-04-10 11:40:07,572 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/quoted/normcharfalse"]
2014-04-10 11:40:07,573 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  parallel execution is enabled: false
2014-04-10 11:40:07,573 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  starting jobs: 1
2014-04-10 11:40:07,573 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  allocating threads: 1
2014-04-10 11:40:07,573 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] starting step: (1/1) ...form/quoted/normcharfalse
2014-04-10 11:40:07,574 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-04-10 11:40:07,575 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-04-10 11:40:07,594 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:07,607 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-04-10 11:40:07,627 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local2066590125_0005
2014-04-10 11:40:07,636 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/staging/brock2066590125/.staging/job_local2066590125_0005/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-04-10 11:40:07,636 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/staging/brock2066590125/.staging/job_local2066590125_0005/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-04-10 11:40:07,660 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/local/localRunner/brock/job_local2066590125_0005/job_local2066590125_0005.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-04-10 11:40:07,660 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/local/localRunner/brock/job_local2066590125_0005/job_local2066590125_0005.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-04-10 11:40:07,661 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-04-10 11:40:07,661 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-04-10 11:40:07,661 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] submitted hadoop job: job_local2066590125_0005
2014-04-10 11:40:07,661 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-04-10 11:40:07,661 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] tracking url: http://localhost:8080/
2014-04-10 11:40:07,664 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-04-10 11:40:07,664 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local2066590125_0005_m_000000_0
2014-04-10 11:40:07,667 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-04-10 11:40:07,668 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited.txt
2014-04-10 11:40:07,668 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@2d13b5e4
2014-04-10 11:40:07,670 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 0
2014-04-10 11:40:07,676 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-10 11:40:07,677 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-10 11:40:07,686 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited.txt"]
2014-04-10 11:40:07,687 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/quoted/normcharfalse"]
2014-04-10 11:40:07,690 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2014-04-10 11:40:07,690 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local2066590125_0005_m_000000_0 is done. And is in the process of committing
2014-04-10 11:40:07,691 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2014-04-10 11:40:07,692 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local2066590125_0005_m_000000_0 is allowed to commit now
2014-04-10 11:40:07,692 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local2066590125_0005_m_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/quoted/normcharfalse/_temporary/0/task_local2066590125_0005_m_000000
2014-04-10 11:40:07,693 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited.txt:0+198
2014-04-10 11:40:07,693 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local2066590125_0005_m_000000_0' done.
2014-04-10 11:40:07,693 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local2066590125_0005_m_000000_0
2014-04-10 11:40:07,693 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-04-10 11:40:07,707 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/quoted/normcharfalse/_temporary
2014-04-10 11:40:07,727 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:07,743 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:07,757 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:07,759 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output//hadoop2-mr1/textdelimitedplatform/quoted/normcharfalse
2014-04-10 11:40:07,831 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-10 11:40:07,831 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.3/fbde5367797af408c100d25704a77959e50a31d8/cascading-hadoop2-mr1-2.5.3.jar
2014-04-10 11:40:07,835 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-04-10 11:40:07,844 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-04-10 11:40:07,845 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-04-10 11:40:07,857 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] starting
2014-04-10 11:40:07,858 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  source: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z'}, String, int, long, String, String, String]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/apache-clean.10.txt"]
2014-04-10 11:40:07,858 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  sink: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z'}, String, int, long, String, String, String]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/testFieldCoercion"]
2014-04-10 11:40:07,858 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  parallel execution is enabled: false
2014-04-10 11:40:07,858 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  starting jobs: 1
2014-04-10 11:40:07,858 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  allocating threads: 1
2014-04-10 11:40:07,858 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] starting step: (1/1) ...latform/testFieldCoercion
2014-04-10 11:40:07,859 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-04-10 11:40:07,859 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-04-10 11:40:07,878 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:07,890 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-04-10 11:40:07,896 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1266926718_0006
2014-04-10 11:40:07,906 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/staging/brock1266926718/.staging/job_local1266926718_0006/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-04-10 11:40:07,907 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/staging/brock1266926718/.staging/job_local1266926718_0006/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-04-10 11:40:07,930 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/local/localRunner/brock/job_local1266926718_0006/job_local1266926718_0006.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-04-10 11:40:07,930 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/local/localRunner/brock/job_local1266926718_0006/job_local1266926718_0006.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-04-10 11:40:07,931 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-04-10 11:40:07,931 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-04-10 11:40:07,931 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] submitted hadoop job: job_local1266926718_0006
2014-04-10 11:40:07,931 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] tracking url: http://localhost:8080/
2014-04-10 11:40:07,931 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-04-10 11:40:07,934 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-04-10 11:40:07,934 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1266926718_0006_m_000000_0
2014-04-10 11:40:07,936 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-04-10 11:40:07,938 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/apache-clean.10.txt
2014-04-10 11:40:07,938 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@4258426
2014-04-10 11:40:07,940 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 0
2014-04-10 11:40:07,946 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-10 11:40:07,946 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-10 11:40:07,963 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z'}, String, int, long, String, String, String]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/apache-clean.10.txt"]
2014-04-10 11:40:07,963 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: Hfs["TextDelimited[['ip', 'client', 'user', 'date', 'request', 'code', 'bytes', 'referrer', 'agent', 'na' | String, String, String, DateType{dateFormatString='dd/MMM/yyyy:HH:mm:ss Z'}, String, int, long, String, String, String]]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/testFieldCoercion"]
2014-04-10 11:40:08,013 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2014-04-10 11:40:08,013 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1266926718_0006_m_000000_0 is done. And is in the process of committing
2014-04-10 11:40:08,014 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2014-04-10 11:40:08,014 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local1266926718_0006_m_000000_0 is allowed to commit now
2014-04-10 11:40:08,015 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1266926718_0006_m_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/testFieldCoercion/_temporary/0/task_local1266926718_0006_m_000000
2014-04-10 11:40:08,016 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/apache-clean.10.txt:0+1449
2014-04-10 11:40:08,016 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1266926718_0006_m_000000_0' done.
2014-04-10 11:40:08,016 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1266926718_0006_m_000000_0
2014-04-10 11:40:08,016 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-04-10 11:40:08,027 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/testFieldCoercion/_temporary
2014-04-10 11:40:08,041 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:08,044 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output//hadoop2-mr1/textdelimitedplatform/testFieldCoercion
2014-04-10 11:40:08,055 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-10 11:40:08,055 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.3/fbde5367797af408c100d25704a77959e50a31d8/cascading-hadoop2-mr1-2.5.3.jar
2014-04-10 11:40:08,065 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:08,070 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-04-10 11:40:08,071 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-04-10 11:40:08,072 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-04-10 11:40:08,079 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] starting
2014-04-10 11:40:08,080 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited-header.txt"]
2014-04-10 11:40:08,080 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  sink: MultiSinkTap[[Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/headerfieldsall1"], Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/headerfieldsall2"]]]
2014-04-10 11:40:08,080 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  parallel execution is enabled: false
2014-04-10 11:40:08,080 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  starting jobs: 1
2014-04-10 11:40:08,080 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  allocating threads: 1
2014-04-10 11:40:08,080 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] starting step: (1/1) ...FCF7C480783E41CCB5C20CE02
2014-04-10 11:40:08,081 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-04-10 11:40:08,082 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-04-10 11:40:08,095 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:08,104 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-04-10 11:40:08,116 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local80434576_0007
2014-04-10 11:40:08,131 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/staging/brock80434576/.staging/job_local80434576_0007/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-04-10 11:40:08,131 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/staging/brock80434576/.staging/job_local80434576_0007/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-04-10 11:40:08,158 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/local/localRunner/brock/job_local80434576_0007/job_local80434576_0007.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-04-10 11:40:08,158 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/local/localRunner/brock/job_local80434576_0007/job_local80434576_0007.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-04-10 11:40:08,159 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-04-10 11:40:08,159 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] submitted hadoop job: job_local80434576_0007
2014-04-10 11:40:08,159 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] tracking url: http://localhost:8080/
2014-04-10 11:40:08,159 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-04-10 11:40:08,159 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-04-10 11:40:08,161 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-04-10 11:40:08,162 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local80434576_0007_m_000000_0
2014-04-10 11:40:08,164 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-04-10 11:40:08,165 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited-header.txt
2014-04-10 11:40:08,165 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@a16d286
2014-04-10 11:40:08,167 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 0
2014-04-10 11:40:08,168 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-10 11:40:08,168 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-10 11:40:08,177 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited-header.txt"]
2014-04-10 11:40:08,178 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: MultiSinkTap[[Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/headerfieldsall1"], Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/headerfieldsall2"]]]
2014-04-10 11:40:08,179 INFO  tap.MultiSinkTap (MultiSinkTap.java:<init>(80)) - opening for write: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/headerfieldsall1"]
2014-04-10 11:40:08,180 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id
2014-04-10 11:40:08,180 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.work.output.dir is deprecated. Instead, use mapreduce.task.output.dir
2014-04-10 11:40:08,180 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:setupTask(98)) - setting up task: 'attempt_local80434576_0007_m_000000_0' - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/headerfieldsall1/_temporary/_attempt_local80434576_0007_m_000000_0
2014-04-10 11:40:08,180 INFO  io.TapOutputCollector (TapOutputCollector.java:initialize(112)) - creating path: part-00000
2014-04-10 11:40:08,184 INFO  tap.MultiSinkTap (MultiSinkTap.java:<init>(80)) - opening for write: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/headerfieldsall2"]
2014-04-10 11:40:08,186 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:setupTask(98)) - setting up task: 'attempt_local80434576_0007_m_000000_0' - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/headerfieldsall2/_temporary/_attempt_local80434576_0007_m_000000_0
2014-04-10 11:40:08,186 INFO  io.TapOutputCollector (TapOutputCollector.java:initialize(112)) - creating path: part-00000
2014-04-10 11:40:08,193 INFO  io.TapOutputCollector (TapOutputCollector.java:close(135)) - closing tap collector for: /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/headerfieldsall1/part-00000
2014-04-10 11:40:08,193 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(155)) - committing task: 'attempt_local80434576_0007_m_000000_0' - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/headerfieldsall1/_temporary/_attempt_local80434576_0007_m_000000_0
2014-04-10 11:40:08,194 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(172)) - saved output of task 'attempt_local80434576_0007_m_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/headerfieldsall1
2014-04-10 11:40:08,194 INFO  io.TapOutputCollector (TapOutputCollector.java:close(135)) - closing tap collector for: /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/headerfieldsall2/part-00000
2014-04-10 11:40:08,195 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(155)) - committing task: 'attempt_local80434576_0007_m_000000_0' - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/headerfieldsall2/_temporary/_attempt_local80434576_0007_m_000000_0
2014-04-10 11:40:08,196 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:commitTask(172)) - saved output of task 'attempt_local80434576_0007_m_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/headerfieldsall2
2014-04-10 11:40:08,197 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2014-04-10 11:40:08,197 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local80434576_0007_m_000000_0 is done. And is in the process of committing
2014-04-10 11:40:08,198 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited-header.txt:0+244
2014-04-10 11:40:08,198 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local80434576_0007_m_000000_0' done.
2014-04-10 11:40:08,198 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local80434576_0007_m_000000_0
2014-04-10 11:40:08,198 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-04-10 11:40:08,234 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:08,252 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:08,276 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:08,277 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output//hadoop2-mr1/textdelimitedplatform/headerfieldsall1
2014-04-10 11:40:08,277 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output//hadoop2-mr1/textdelimitedplatform/headerfieldsall2
2014-04-10 11:40:08,290 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-10 11:40:08,290 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.3/fbde5367797af408c100d25704a77959e50a31d8/cascading-hadoop2-mr1-2.5.3.jar
2014-04-10 11:40:08,293 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-04-10 11:40:08,295 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-04-10 11:40:08,298 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] starting
2014-04-10 11:40:08,299 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited.txt"]
2014-04-10 11:40:08,299 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/header"]
2014-04-10 11:40:08,299 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  parallel execution is enabled: false
2014-04-10 11:40:08,299 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  starting jobs: 1
2014-04-10 11:40:08,299 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  allocating threads: 1
2014-04-10 11:40:08,300 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] starting step: (1/1) ...tdelimitedplatform/header
2014-04-10 11:40:08,300 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-04-10 11:40:08,302 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-04-10 11:40:08,318 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:08,330 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-04-10 11:40:08,343 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local1289291334_0008
2014-04-10 11:40:08,355 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/staging/brock1289291334/.staging/job_local1289291334_0008/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-04-10 11:40:08,355 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/staging/brock1289291334/.staging/job_local1289291334_0008/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-04-10 11:40:08,388 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/local/localRunner/brock/job_local1289291334_0008/job_local1289291334_0008.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-04-10 11:40:08,388 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/local/localRunner/brock/job_local1289291334_0008/job_local1289291334_0008.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-04-10 11:40:08,389 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-04-10 11:40:08,389 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-04-10 11:40:08,390 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] submitted hadoop job: job_local1289291334_0008
2014-04-10 11:40:08,390 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-04-10 11:40:08,390 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] tracking url: http://localhost:8080/
2014-04-10 11:40:08,392 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-04-10 11:40:08,393 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local1289291334_0008_m_000000_0
2014-04-10 11:40:08,395 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-04-10 11:40:08,396 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited.txt
2014-04-10 11:40:08,397 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@2daf73a4
2014-04-10 11:40:08,398 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 0
2014-04-10 11:40:08,404 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-10 11:40:08,404 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-10 11:40:08,413 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited.txt"]
2014-04-10 11:40:08,413 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/header"]
2014-04-10 11:40:08,419 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2014-04-10 11:40:08,419 INFO  mapred.Task (Task.java:done(995)) - Task:attempt_local1289291334_0008_m_000000_0 is done. And is in the process of committing
2014-04-10 11:40:08,420 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - 
2014-04-10 11:40:08,420 INFO  mapred.Task (Task.java:commit(1156)) - Task attempt_local1289291334_0008_m_000000_0 is allowed to commit now
2014-04-10 11:40:08,420 INFO  output.FileOutputCommitter (FileOutputCommitter.java:commitTask(439)) - Saved output of task 'attempt_local1289291334_0008_m_000000_0' to file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/header/_temporary/0/task_local1289291334_0008_m_000000
2014-04-10 11:40:08,421 INFO  mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(591)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited.txt:0+198
2014-04-10 11:40:08,421 INFO  mapred.Task (Task.java:sendDone(1115)) - Task 'attempt_local1289291334_0008_m_000000_0' done.
2014-04-10 11:40:08,421 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(249)) - Finishing task: attempt_local1289291334_0008_m_000000_0
2014-04-10 11:40:08,421 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-04-10 11:40:08,436 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/header/_temporary
2014-04-10 11:40:08,454 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:08,456 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output//hadoop2-mr1/textdelimitedplatform/header
2014-04-10 11:40:08,471 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2014-04-10 11:40:08,471 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(205)) - using application jar: /home/brock/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.5.3/fbde5367797af408c100d25704a77959e50a31d8/cascading-hadoop2-mr1-2.5.3.jar
2014-04-10 11:40:08,474 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-04-10 11:40:08,476 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-04-10 11:40:08,476 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(996)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-04-10 11:40:08,479 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] starting
2014-04-10 11:40:08,480 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  source: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited-extra-field.txt"]
2014-04-10 11:40:08,480 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  sink: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/strict-nondeterministic"]
2014-04-10 11:40:08,480 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  parallel execution is enabled: false
2014-04-10 11:40:08,480 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  starting jobs: 1
2014-04-10 11:40:08,480 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe]  allocating threads: 1
2014-04-10 11:40:08,480 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] starting step: (1/1) ...m/strict-nondeterministic
2014-04-10 11:40:08,480 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-04-10 11:40:08,481 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-04-10 11:40:08,489 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2014-04-10 11:40:08,495 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:1
2014-04-10 11:40:08,502 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local189027121_0009
2014-04-10 11:40:08,513 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/staging/brock189027121/.staging/job_local189027121_0009/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-04-10 11:40:08,513 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/staging/brock189027121/.staging/job_local189027121_0009/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-04-10 11:40:08,535 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/local/localRunner/brock/job_local189027121_0009/job_local189027121_0009.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2014-04-10 11:40:08,536 WARN  conf.Configuration (Configuration.java:loadProperty(2345)) - file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/tmp/mapred/local/localRunner/brock/job_local189027121_0009/job_local189027121_0009.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2014-04-10 11:40:08,536 INFO  mapreduce.Job (Job.java:submit(1289)) - The url to track the job: http://localhost:8080/
2014-04-10 11:40:08,536 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2014-04-10 11:40:08,536 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] submitted hadoop job: job_local189027121_0009
2014-04-10 11:40:08,537 INFO  mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2014-04-10 11:40:08,537 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] tracking url: http://localhost:8080/
2014-04-10 11:40:08,539 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2014-04-10 11:40:08,540 INFO  mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local189027121_0009_m_000000_0
2014-04-10 11:40:08,542 INFO  mapred.Task (Task.java:initialize(581)) -  Using ResourceCalculatorProcessTree : [ ]
2014-04-10 11:40:08,543 INFO  io.MultiInputSplit (MultiInputSplit.java:readFields(161)) - current split input path: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited-extra-field.txt
2014-04-10 11:40:08,543 INFO  mapred.MapTask (MapTask.java:updateJobWithSplit(462)) - Processing split: cascading.tap.hadoop.io.MultiInputSplit@7ff7709b
2014-04-10 11:40:08,545 INFO  mapred.MapTask (MapTask.java:runOldMapper(416)) - numReduceTasks: 0
2014-04-10 11:40:08,550 INFO  hadoop.FlowMapper (FlowMapper.java:configure(70)) - cascading version: 2.5.3
2014-04-10 11:40:08,550 INFO  hadoop.FlowMapper (FlowMapper.java:configure(71)) - child jvm opts: -Xmx200m
2014-04-10 11:40:08,558 INFO  hadoop.FlowMapper (FlowMapper.java:configure(86)) - sourcing from: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited-extra-field.txt"]
2014-04-10 11:40:08,558 INFO  hadoop.FlowMapper (FlowMapper.java:configure(89)) - sinking to: Hfs["TextDelimited[['first', 'second', 'third', 'fourth', 'fifth']]"]["/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/strict-nondeterministic"]
2014-04-10 11:40:08,560 ERROR stream.TrapHandler (TrapHandler.java:handleReThrowableException(103)) - caught Throwable, no trap available, rethrowing
cascading.tuple.TupleException: unable to read from input identifier: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited-extra-field.txt
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:127)
	at cascading.flow.stream.SourceStage.map(SourceStage.java:76)
	at cascading.flow.stream.SourceStage.run(SourceStage.java:58)
	at cascading.flow.hadoop.FlowMapper.run(FlowMapper.java:127)
	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:430)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:342)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
	at java.util.concurrent.FutureTask.run(FutureTask.java:166)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:724)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
	at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
	at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
	at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1008)
	at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:140)
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:120)
	... 12 more
2014-04-10 11:40:08,562 ERROR stream.SourceStage (SourceStage.java:map(110)) - caught throwable
cascading.tuple.TupleException: unable to read from input identifier: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited-extra-field.txt
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:127)
	at cascading.flow.stream.SourceStage.map(SourceStage.java:76)
	at cascading.flow.stream.SourceStage.run(SourceStage.java:58)
	at cascading.flow.hadoop.FlowMapper.run(FlowMapper.java:127)
	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:430)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:342)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
	at java.util.concurrent.FutureTask.run(FutureTask.java:166)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:724)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
	at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
	at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
	at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1008)
	at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:140)
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:120)
	... 12 more
2014-04-10 11:40:08,562 INFO  mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2014-04-10 11:40:08,565 WARN  mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local189027121_0009
java.lang.Exception: cascading.tuple.TupleException: unable to read from input identifier: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited-extra-field.txt
	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
Caused by: cascading.tuple.TupleException: unable to read from input identifier: file:/home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/classes/test/data/delimited-extra-field.txt
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:127)
	at cascading.flow.stream.SourceStage.map(SourceStage.java:76)
	at cascading.flow.stream.SourceStage.run(SourceStage.java:58)
	at cascading.flow.hadoop.FlowMapper.run(FlowMapper.java:127)
	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:430)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:342)
	at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
	at java.util.concurrent.FutureTask.run(FutureTask.java:166)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:724)
Caused by: cascading.tap.TapException: did not parse correct number of values from input data, expected: 5, got: 6:,,,,7,extra-data
	at cascading.scheme.util.DelimitedParser.onlyParseLine(DelimitedParser.java:404)
	at cascading.scheme.util.DelimitedParser.parseLine(DelimitedParser.java:341)
	at cascading.scheme.hadoop.TextDelimited.source(TextDelimited.java:1008)
	at cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:140)
	at cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:120)
	... 12 more
2014-04-10 11:40:08,568 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [pipe] hadoop job job_local189027121_0009 state at FAILED
2014-04-10 11:40:08,568 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [pipe] failure info: NA
2014-04-10 11:40:08,569 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [pipe] task completion events identify failed tasks
2014-04-10 11:40:08,569 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [pipe] task completion events count: 0
2014-04-10 11:40:08,570 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] stopping all jobs
2014-04-10 11:40:08,570 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [pipe] stopping: (1/1) ...m/strict-nondeterministic
2014-04-10 11:40:08,570 INFO  flow.Flow (BaseFlow.java:logInfo(1354)) - [pipe] stopped all jobs
2014-04-10 11:40:08,570 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output/hadoop2-mr1/textdelimitedplatform/strict-nondeterministic/_temporary
2014-04-10 11:40:08,570 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/brock/workspaces/cascading-compat/cascading.compatibility/cloudera-hadoop2-5.0/build/test/output//hadoop2-mr1/textdelimitedplatform/strict-nondeterministic